curl-and-python

Downloading straight to memory

From: Josh Mayer <joshuaamayer_at_gmail.com>
Date: Fri, 4 Sep 2009 21:44:51 -0400

Hi,

I am looking to use pycurl to fetch urls and store the text in a
database.  I would like to have the urls fetched straight to memory
(as in the getinmemory.c example) but this seems impossible in pycurl.
 Being able to use StringIO from the cStringIO module instead of a
file handle would be really nice. Any ideas on how to go about doing
this? The use case I have is such that the time needed in reading the
files from disk is significant and would be ideal to eliminate. Thanks
for the help.
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-python
Received on 2009-09-05