Jason Todd Slack-Moehrle wrote:

> So what tool does one use to evaluate the links, etc? How can I make
> decisions and such?

Take a look at Wget (http://www.gnu.org/software/wget/).
It has features you need.

-- 
Piotr Dobrogost
*** curlpp.org - c++ wrapper for libcurl ***
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html