curl / Mailing Lists / curl-library / Single Mail

curl-library

Re: Windows users! Help us test upload performance tuning?

From: Jan Ehrhardt via curl-library <curl-library_at_cool.haxx.se>
Date: Fri, 10 Aug 2018 17:25:51 +0200

Jan Ehrhardt via curl-library (Fri, 10 Aug 2018 03:29:21 +0200):
>Gisle Vanem via curl-library (Thu, 9 Aug 2018 18:31:12 +0200):
>>Jan Ehrhardt wrote:
>>
>>>> Wow dude! 2 times faster than FileZilla now.
>>>>
>>>> Time decreased from 33.153s to 6.4 sec (same random 10 MByte file).
>>>> Versus approx. 5.3 sec for curl/FTP.
>>>
>>> Using SFTP?
>>
>>Yes:
>>curl.exe -k -# --write-out "speed: %%{speed_upload} bytes/sec, total-time: %%{time_total}" ^
>> sftp://xyz -T c:\TEMP\curl-test.file
>>speed: 1649348,000 bytes/sec, total-time: 6,063000
>
>Can you make your compiled version available somewhere? I tried different
>combinations of VC9, VC11, VC14 and x86 / x64 and cannot get it higher than 300k
>at the moment.

I even cross-compiled curl.exe with GCC 7.3.1 on a Ubuntu 16.04 machine, linking
libssh2 1.8.0 (also compiled with GCC 7.3.1):
https://phpdev.toolsforresearch.com/curl-mingw32-7.61.0.zip

It has both patches: the winsock patch and the sftp uploadbuffer one. Uploading
over sftp went up from 145k to about 300KB/s, but nowhere near the 4+ MB/s of
the other methods.

Interesting about the cross-compiled versions: they include a static OpenSSL
1.0.2o module (also cross-compiled by GCC), that somehow reads the system
certificate store of the Windows machines.

-- 
Jan
Microsoft Windows [Version 6.1.7601]
running lftp....
ptime 1.0 for Win32, Freeware - http://www.pc-tools.net/
Copyright(C) 2002, Jem Berkes <jberkes_at_pc-tools.net>
===  E:\utils\bash.exe /utils/bash.sh ===
Execution time: 69.934 s
running vanilla...
ptime 1.0 for Win32, Freeware - http://www.pc-tools.net/
Copyright(C) 2002, Jem Berkes <jberkes_at_pc-tools.net>
===  curl -w"start:%{time_starttransfer} total:%{time_total}\n"  (removed)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  274M    0     0  100  274M      0  5062k  0:00:55  0:00:55 --:--:-- 5200k
start:0,390000 total:55,506000
Execution time: 55.667 s
running patched...
ptime 1.0 for Win32, Freeware - http://www.pc-tools.net/
Copyright(C) 2002, Jem Berkes <jberkes_at_pc-tools.net>
===  curl -w"start:%{time_starttransfer} total:%{time_total}\n"  (removed)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  274M    0     0  100  274M      0  6825k  0:00:41  0:00:41 --:--:-- 6231k
start:0,375000 total:41,169000
Execution time: 41.320 s
running curl-mingw64 patched...
ptime 1.0 for Win32, Freeware - http://www.pc-tools.net/
Copyright(C) 2002, Jem Berkes <jberkes_at_pc-tools.net>
===  curl -w"start:%{time_starttransfer} total:%{time_total}\n"  (removed)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  274M    0     0  100  274M      0  6550k  0:00:42  0:00:42 --:--:-- 6043k
start:0,374000 total:42,900000
Execution time: 43.048 s
running curl-mingw64 sftp
ptime 1.0 for Win32, Freeware - http://www.pc-tools.net/
Copyright(C) 2002, Jem Berkes <jberkes_at_pc-tools.net>
===  curl -w"start:%{time_starttransfer} total:%{time_total}\n"  (removed)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  274M    0     0  100  274M      0   298k  0:15:42  0:15:42 --:--:--  313k
100  274M    0     0  100  274M      0   298k  0:15:42  0:15:42 --:--:--  298k
start:0,640000 total:942,153000
Execution time: 942.211 s
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette:   https://curl.haxx.se/mail/etiquette.html
Received on 2018-08-10