curl-and-php
Bypass robots.txt
From: vivekanandan <vivekanandan_at_comodo.com>
Date: Tue, 25 Apr 2006 12:35:17 +0530
Date: Tue, 25 Apr 2006 12:35:17 +0530
When I am using curl, I want to bypass sites with robots protocol... Is
it possible to do this ?
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php
Received on 2006-04-25