curl-users
Re: help to download web pages
Date: Thu, 18 Dec 2003 00:28:37 -0600
It's possible that you can ignore the frameset page and simply start
with either the search_results.jhtml link or the initial_preview.jhtml
link, but you need to make sure that nothing useful is being given you
with the frameset.
In one particular case here, I have to get the frameset page, followed
by a menu frame and then go fetch the main frame page (which is what I
really want), because both the frameset and the menu pages hand me
cookies that are critical to the main frame... Kinda stupid, but I
don't control the server or the guys developing stuff for it. I just
have to work up a script to watch the server...
Ralph
Georg Horn wrote:
>On Wed, Dec 17, 2003 at 10:19:58AM -0700, Wesley Sgroi wrote:
>
>
>
>>[html response using curl]
>>============================================================================
>><frameset rows="*,0" cols="*" bordercolor="#CCCCCC" frameborder="NO">
>><frame name="top" scrolling="AUTO" noresize target="middle"
>>src="/search/used/cc/standard/results/multiple/search_results.jhtml?aff=national&src=">
>><frame name="preview"
>>src="/search/used/cc/standard/results/single/initial_preview.jhtml?aff=national&cid="
>>scrolling="auto">
>>
>>
>
>Well, obviously you have to imitate the behaviour of a browser, parse the
>html-code and fetch also the two urls that a real browser would load into the
>two frames.
>
>
>
>><noframes>
>><body>
>><p>This page uses frames, but your browser doesn't support them.</p>
>></body>
>></noframes>
>>
>>
>
>A real browser would only display this text, if it supported no frames, so
>you can safely ignore this.
>
>Bye,
>Georg
>
>
>
>-------------------------------------------------------
>This SF.net email is sponsored by: IBM Linux Tutorials.
>Become an expert in LINUX or just sharpen your skills. Sign up for IBM's
>Free Linux Tutorials. Learn everything from the bash shell to sys admin.
>Click now! http://ads.osdn.com/?ad_id=1278&alloc_id=3371&op=click
>
>
-------------------------------------------------------
This SF.net email is sponsored by: IBM Linux Tutorials.
Become an expert in LINUX or just sharpen your skills. Sign up for IBM's
Free Linux Tutorials. Learn everything from the bash shell to sys admin.
Click now! http://ads.osdn.com/?ad_id=1278&alloc_id=3371&op=click
Received on 2003-12-18