Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Re: Can find a line with curl
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: Dan Fandrich via curl-users <curl-users_at_lists.haxx.se>
Date: Sat, 20 Jan 2024 00:21:34 -0800
On Fri, Jan 19, 2024 at 11:42:42PM -0800, ToddAndMargo via curl-users wrote:
> With Firefox:
>
> view-source:https://semiconductor.samsung.com/consumer-storage/support/tools/
>
> I find this line.
>
> 6219: <a href="https://semiconductor.samsung.com/resources/software-resources/Samsung_Data_Migration_Setup_4.0.0.18.exe"
> target="_blank" data-an-tr="hero banner" data-an-ca="outbound click"
> data-an-ac="download file" data-an-la="data migration software">
>
>
> But I can not find it with cURL:
Chances are, the site thinks you're running a robot and is providing a
different page to curl than Firefox. Try matching the Firefox headers exactly
and you might get something different. Or, it might be basing the difference on
the presence of cookies. Try enabling cookie support and go get a cookie from
another page first before downloading this one. You can use Firefox's "Copy as
cURL" feature to get a curl command-line with all the headers and cookies as
used by Firefox to test this theory fairly easily.
Dan
Date: Sat, 20 Jan 2024 00:21:34 -0800
On Fri, Jan 19, 2024 at 11:42:42PM -0800, ToddAndMargo via curl-users wrote:
> With Firefox:
>
> view-source:https://semiconductor.samsung.com/consumer-storage/support/tools/
>
> I find this line.
>
> 6219: <a href="https://semiconductor.samsung.com/resources/software-resources/Samsung_Data_Migration_Setup_4.0.0.18.exe"
> target="_blank" data-an-tr="hero banner" data-an-ca="outbound click"
> data-an-ac="download file" data-an-la="data migration software">
>
>
> But I can not find it with cURL:
Chances are, the site thinks you're running a robot and is providing a
different page to curl than Firefox. Try matching the Firefox headers exactly
and you might get something different. Or, it might be basing the difference on
the presence of cookies. Try enabling cookie support and go get a cookie from
another page first before downloading this one. You can use Firefox's "Copy as
cURL" feature to get a curl command-line with all the headers and cookies as
used by Firefox to test this theory fairly easily.
Dan
-- Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users Etiquette: https://curl.se/mail/etiquette.htmlReceived on 2024-01-20