cURL / Mailing Lists / curl-users / Single Mail

curl-users

Re: Curl command line and libcurl is much slower than wget

From: Dan Fandrich <dan_at_coneharvesters.com>
Date: Fri, 13 Jan 2012 01:06:35 -0800

On Fri, Jan 13, 2012 at 04:41:13PM +0800, curl wrote:
> I use libcurl in my project to get the file on remote http server.

What version of libcurl? What kind of network connection do you have to
the remote server? Are you doing straight HTTP or HTTPS? If the latter,
which SSL library are you using?

> I tried the curl command line and I found that the download speed is only
> 12MByte/sec.
> I tried the wget command line and the download speed is 110MByte/sec.

That does seem odd. The curl command-line client is generally no slouch.
What command-line are you using do do the download?

> I thought that there was something wrong with curl command line, and use
> libcurl in my project. I use curl_easy_recv to receive data and the download
> speed is the same with curl command line, 12MByte/sec.

What kind of protocol are you using? It's very seldom necessary to use
curl_easy_recv().

> For testing, I just receive the data and simply write to /dev/null, so there is
> no disk i/o on client side. I use dell server which have 12 core and 24
> physical threads, 64GByte memory to do the experiments. I don't no where the
> problem is, and is there anyone can help me ?

>>> Dan
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2012-01-13