cURL / Mailing Lists / curl-users / Single Mail

curl-users

Max Get Limit

From: Tom Kucera <Thomas_Kucera_at_brown.edu>
Date: Sun, 24 Dec 2000 15:09:30 -0500

Is there a max. amount of data that curl will return? I'm using the below
code to extract web pages, but for this one page it never returns all of the
data. It stops returning near the bottom. Every time I run it, it stops in a
different place. However curl says that it succesfully completed even though
a couple of lines from the page are missing.

$command = "$curl \"$url\" $param -v -S -i -A \"Mozilla/4.0\" -o
\"file.txt\" $thegoods";
my @output = `$command`;

I then print out @output.

Thoughts?

Thanks,
Tom
Received on 2000-12-24