cURL / Mailing Lists / curl-library / Single Mail

curl-library

Re: Could http pipelining be an issue ?

From: Daniel Stenberg <daniel_at_haxx.se>
Date: Tue, 8 May 2007 15:41:27 +0200 (CEST)

On Tue, 8 May 2007, Nicolas REMIA wrote:

> Im using libcurl in that way: i have 20 threads, and each thread manages an
> easy curl handle. Then, threads fight to obtain an url (in a shared pool) to
> download. Most of my requests are ranged requests.

But you do try to make the same handles transfer from the same host again,
right? I mean so that you can use persistent connections as far as possible.

> Should i manage myself to ask for several objects in one request using a
> ranged request like => 0-42,142-242,330-369. It means a local pool for each
> thread, waiting for a minimum number of files to download. Or should i use
> http pipelining ? My main problem is to dodge the latency, so make the less
> number of requests.

I would assume that you can do both and gain performance for both steps.

-- 
  Commercial curl and libcurl Technical Support: http://haxx.se/curl.html
Received on 2007-05-08