I am maintaining an app that crawls a set of web pages using pycurl.
I have been recently running into a set of pages that require
authentication, and I would like to treat those as 'timed out' or
unreadable pages. Instead, the thread that reads those pages is being
blocked with a "Enter password for hostname: " request that waits for
keyboard input. After enough time all of my threads end up blocking,
waiting for a password.

How can I tell pycurl to skip past pages that ask for authentication,
or always 'cancel' the authentication?

_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-python
Received on 2006-02-14