cURL / Mailing Lists / curl-users / Single Mail

curl-users

Re: Re: GnuTLS recv error (-9): A TLS packet with unexpected length was received. - with Paypal Website Payment Pro (Daniel Stenberg)

From: Zachary Krebs <zkrebs_at_gmail.com>
Date: Tue, 1 Feb 2011 09:19:48 -0800

Daniel,

Totally new to the list and submitting things like this, sorry if this
is an abomination.

re my issue, "GnuTLS recv error (-9): A TLS packet with unexpected
length was received. - with Paypal Website Payment Pro"

Additional System Info:
ibcurl3-gnutls (7.18.0-1ubuntu2.2)
libcurl4-gnutls-dev (7.21.0-1ubuntu1)
gnupg (1.4.10-2ubuntu1)

I'm unaware of how to give you more specifics about the version, but I
hope this is enough to specify the Ubuntu packages I'm using, that
aren't offering any updates at the moment.

I took your advise and posted this to the gnutls list, and will report
a solution I find, promise.

Zachary Krebs
Business Line ~ M-F 8-5PM ~ (541)708-1163
Support - create account or login to your customer portal or email
zkrebs_at_gmail.com

On Tue, Feb 1, 2011 at 3:00 AM, <curl-users-request_at_cool.haxx.se> wrote:
> Send curl-users mailing list submissions to
>        curl-users_at_cool.haxx.se
>
> To subscribe or unsubscribe via the World Wide Web, visit
>        http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
> or, via email, send a message with subject or body 'help' to
>        curl-users-request_at_cool.haxx.se
>
> You can reach the person managing the list at
>        curl-users-owner_at_cool.haxx.se
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of curl-users digest..."
>
>
> Today's Topics:
>
>   1. Re: Using curl to download CBOE csv file quotes...help!
>      (dsisk_at_nc.rr.com)
>   2. cURL script help (Michael Herbig)
>   3. Re: cURL script help (Christopher Stone)
>   4. Re: Using curl to download CBOE csv file quotes...help!
>      (Ralph Mitchell)
>   5. Re: cURL script help (chr)
>   6. GnuTLS recv error (-9): A TLS packet with unexpected length
>      was       received. - with Paypal Website Payment Pro (Zachary Krebs)
>   7. Re: GnuTLS recv error (-9): A TLS packet with unexpected
>      length was        received. - with Paypal Website Payment Pro
>      (Daniel Stenberg)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 31 Jan 2011 14:13:54 -0500
> From: <dsisk_at_nc.rr.com>
> To: the curl tool <curl-users_at_cool.haxx.se>
> Cc: Yves PETRONIN <y.petronin_at_wanadoo.fr>
> Subject: Re: Using curl to download CBOE csv file quotes...help!
> Message-ID: <20110131191355.QMGF0.42533.root_at_cdptpa-web23-z02>
> Content-Type: text/plain; charset=utf-8
>
> Oh yeah, I've found the -c and -b cookie options...just not any example of how to use them with this blasted CBOE site! ;-)
>
> ---- Daniel Stenberg <daniel_at_haxx.se> wrote:
>> On Sat, 29 Jan 2011, dsisk_at_nc.rr.com wrote:
>>
>> > So there are cookies involved.  Doesn't curl support a way to pass cookies
>> > to a site?  Any idea how to formulate the curl command with cookie data in
>> > this particular situation?
>>
>> Sure it does. Use -c to store them to a file and -b to read them from a file.
>>
>> Surely searching for "cookie" in the man page would've found these...
>>
>> --
>>
>>   / daniel.haxx.se
>> -------------------------------------------------------------------
>> List admin: http://cool.haxx.se/list/listinfo/curl-users
>> FAQ:        http://curl.haxx.se/docs/faq.html
>> Etiquette:  http://curl.haxx.se/mail/etiquette.html
>
>
>
> ------------------------------
>
> Message: 2
> Date: Mon, 31 Jan 2011 15:41:13 -0500
> From: Michael Herbig <mikeherbig_at_gmail.com>
> To: curl-users_at_cool.haxx.se
> Subject: cURL script help
> Message-ID:
>        <AANLkTikqioD8bbxX1Vm8Vz4CuES4m-YZW9ZMpszQBC2e_at_mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hello folks,
>
> I'm having an issue with a simple curl script, and maybe someone can help.
>
> I'm trying to download customer comments to products on my site generated
> from a rating service, called RateVoice.  An example of the service is here
> (this is not my site, just an example):
>
> http://www.edgeangling.com/Daiwa-SW4000-B.html
>
> These reviews are housed on a separate server (RateVoice's), and do not
> appear when I attempt to curl the page, I believe because they are generated
> dynamically via a javascript script.
>
> My goal is to download all customer comments, strip away the extraneous
> text, and parse the fields into a .csv file.  This is further complicated by
> the fact that there can be multiple pages of comments (via the "next" and
> "back" links), but just getting curl/wget to get the data would be a good
> start.
>
> Is there a different way I can scrape this information via curl or something
> else?
>
> Thanks for your help,
>
> Mike
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://cool.haxx.se/pipermail/curl-users/attachments/20110131/33b05bb6/attachment-0001.htm>
>
> ------------------------------
>
> Message: 3
> Date: Mon, 31 Jan 2011 15:57:38 -0600
> From: Christopher Stone <listmeister_at_thestoneforge.com>
> To: the curl tool <curl-users_at_cool.haxx.se>
> Subject: Re: cURL script help
> Message-ID: <6FF2046B-BD94-4135-8993-6B5D7ECB3A76_at_thestoneforge.com>
> Content-Type: text/plain; charset=us-ascii
>
> On Jan 31, 2011, at 14:41, Michael Herbig wrote:
>> My goal is to download all customer comments, strip away the extraneous text, and parse the fields into a .csv file.  This is further complicated by the fact that there can be multiple pages of comments (via the "next" and "back" links), but just getting curl/wget to get the data would be a good start.
> ______________________________________________________________________
>
> Hey Mike,
>
> Since you were having trouble getting your data using curl I first tried dumping the url with Lynx and found the reviews right away.
>
> Then I simply tried: curl http://www.edgeangling.com/Daiwa-SW4000-B.html
>
> And I was able to find the complete text of the two reviews in the source.  I just searched for "\bpros\b" with grep and found them right away.
>
> (curl 7.21.2 (x86_64-apple-darwin10.4.0) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.5 libidn/1.19)
>
> HTH
>
> --
> Best Regards,
> Christopher Stone
>
>
>
>
> ------------------------------
>
> Message: 4
> Date: Mon, 31 Jan 2011 17:58:12 -0500
> From: Ralph Mitchell <ralphmitchell_at_gmail.com>
> To: the curl tool <curl-users_at_cool.haxx.se>
> Subject: Re: Using curl to download CBOE csv file quotes...help!
> Message-ID:
>        <AANLkTikjfS1pM2cFoS2guaPKDySZGshOyR1PRUHS3sdE_at_mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> On Mon, Jan 31, 2011 at 2:13 PM, <dsisk_at_nc.rr.com> wrote:
>
>> Oh yeah, I've found the -c and -b cookie options...just not any example of
>> how to use them with this blasted CBOE site! ;-)
>>
>>
> Sigh - top-posting...
>
> I usually just put a standard set of curl options at the top of my scripts,
> then reference it later:
>
>     CURLOPTS="-b cookies -c cookies -s -S -L -m 30"
>     ...
>     curl $CURLOPTS -o file.html http://server.domain.com/stuff/things/
>
> If the cookie file doesn't exist, it gets created, relevant cookies are sent
> to the host, all cookies are saved when curl exits.
>
> Ralph Mitchell
>
>
>
>> ---- Daniel Stenberg <daniel_at_haxx.se> wrote:
>> > On Sat, 29 Jan 2011, dsisk_at_nc.rr.com wrote:
>> >
>> > > So there are cookies involved.  Doesn't curl support a way to pass
>> cookies
>> > > to a site?  Any idea how to formulate the curl command with cookie data
>> in
>> > > this particular situation?
>> >
>> > Sure it does. Use -c to store them to a file and -b to read them from a
>> file.
>> >
>> > Surely searching for "cookie" in the man page would've found these...
>>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://cool.haxx.se/pipermail/curl-users/attachments/20110131/67538a22/attachment-0001.htm>
>
> ------------------------------
>
> Message: 5
> Date: Mon, 31 Jan 2011 22:40:34 +0100
> From: chr <chr+curl_at_tx0.org>
> To: curl-users_at_cool.haxx.se
> Subject: Re: cURL script help
> Message-ID: <20110131214034.GA19455_at_SDF.LONESTAR.ORG>
> Content-Type: text/plain; charset=us-ascii
>
> Michael Herbig (Monday 31 January 2011, 21:04):
>>
>> I'm trying to download customer comments to products on my site generated
>> from a rating service, called RateVoice.  An example of the service is here
>> (this is not my site, just an example):
>>
>> http://www.edgeangling.com/Daiwa-SW4000-B.html
>>
>> These reviews are housed on a separate server (RateVoice's), and do not
>> appear when I attempt to curl the page, I believe because they are generated
>> dynamically via a javascript script.
>
> Probably I'm missing something, but in the example above I can see
> the comments in the HTML source, like
>
> <div class="ratevoice-review-body">
>  COMMENT HERE
> </div>
>
> You'll have to figure out how to extract the relevant pieces from
> the source.
>
> If the above example is not like the problem you are facing, could
> you provide a link to an appropriate example?
>
> Regards.
>
> --
> SDF Public Access UNIX System - http://sdf.lonestar.org
>
>
> ------------------------------
>
> Message: 6
> Date: Mon, 31 Jan 2011 16:22:42 -0800
> From: Zachary Krebs <zkrebs_at_gmail.com>
> To: curl-users_at_cool.haxx.se
> Subject: GnuTLS recv error (-9): A TLS packet with unexpected length
>        was     received. - with Paypal Website Payment Pro
> Message-ID:
>        <AANLkTinSy59Epri-mAV=yzzjogtZdrOXjRW-t8h3MMd+@mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> Thanks for considering my support request, and I hope I do not
> agitate/irritate anyone by posting in the wrong place.
> I looked here first:?http://curl.haxx.se/mail/lib-2010-06/0169.html
> and did not find a resolution.
>
> I am attempting to use the Website Payment Pro Paypal module with Drupal CMS.
>
> My system is:
> Ubuntu 10.04 32-bit
> libcurl 7.19.7
> PHP 5.2.16 with Suhosin-Patch 0.9.7 (cli) (built: Dec 25 2010 19:12:01)
> Copyright (c) 1997-2009 The PHP Group
> Zend Engine v2.2.0, Copyright (c) 1998-2010 Zend Technologies
> Drupal 6
> Nginx 0.9.3
>
> When I attempt to complete a payment, I get an error in my log:
> "GnuTLS recv error (-9): A TLS packet with unexpected length was received"
>
> I searched all over Google, and another party stated "I will say this
> about the Paypal WPP service...I have been on it since it was
> available and find most (if not all) of our headache problems to be
> related to a dependency between some platform library and curl."
>
> Could someone point me in the right direction of getting this solved,
> perhaps I need to update a library or piece of software?
>
> https://bugs.launchpad.net/gwibber/+bug/626023/comments/28?was also
> suggested, "The only way i managed to get rid of that error, was by
> recompiling libcurl with OpenSSL instead of GnuTLS and then
> recompiling python-pycurl against the new cURL library."
>
> Thanks for your help,
> Zachary
>
>
> ------------------------------
>
> Message: 7
> Date: Tue, 1 Feb 2011 11:52:38 +0100 (CET)
> From: Daniel Stenberg <daniel_at_haxx.se>
> To: the curl tool <curl-users_at_cool.haxx.se>
> Subject: Re: GnuTLS recv error (-9): A TLS packet with unexpected
>        length was      received. - with Paypal Website Payment Pro
> Message-ID: <alpine.DEB.2.00.1102011138380.4182_at_tvnag.unkk.fr>
> Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
>
> On Mon, 31 Jan 2011, Zachary Krebs wrote:
>
>> I looked here first:?http://curl.haxx.se/mail/lib-2010-06/0169.html and did
>> not find a resolution.
>
> In that thread I clearly asked the person to contact the GnuTLS team to see if
> they could help out as it seems to me like the problem migth exist in there.
>
> My advice was obviously mostly ignored. At least the thread died at that
> point. A common problem with people asking for help is that they never follow
> through and actually present the solution in the end.
>
> Left for the world is then only questions and problem statements.
>
>> Ubuntu 10.04 32-bit
>> libcurl 7.19.7
>> PHP 5.2.16 with Suhosin-Patch 0.9.7 (cli) (built: Dec 25 2010 19:12:01)
>> Copyright (c) 1997-2009 The PHP Group
>> Zend Engine v2.2.0, Copyright (c) 1998-2010 Zend Technologies
>> Drupal 6
>> Nginx 0.9.3
>
> Your GnuTLS version is also highly relevant.
>
>> When I attempt to complete a payment, I get an error in my log:
>> "GnuTLS recv error (-9): A TLS packet with unexpected length was received"
>
> What if you use the regular curl command tool built with the same GnuTLS, does
> that work against the same site?
>
>> I searched all over Google, and another party stated "I will say this about
>> the Paypal WPP service...I have been on it since it was available and find
>> most (if not all) of our headache problems to be related to a dependency
>> between some platform library and curl."
>
> As you didn't find it on curl.haxx.se and you certainly did not find anyone
> with any decent amount of libcurl knowledge saying something like that, it has
> very little to no value at all for both you and us.
>
>> Could someone point me in the right direction of getting this solved,
>> perhaps I need to update a library or piece of software?
>
> Perhaps, yes. But as we don't know what the problem is yet we can't really
> tell.
>
>> https://bugs.launchpad.net/gwibber/+bug/626023/comments/28?was also
>> suggested, "The only way i managed to get rid of that error, was by
>> recompiling libcurl with OpenSSL instead of GnuTLS and then recompiling
>> python-pycurl against the new cURL library."
>
> Of course, if you rebuild with another SSL library you will no longer suffer
> from problems with GnuTLS... It doesn't make us actually find or fix the
> problem though.
>
> --
>
>  / daniel.haxx.se
>
> ------------------------------
>
> _______________________________________________
> curl-users mailing list
> curl-users_at_cool.haxx.se
> http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
>
>
> End of curl-users Digest, Vol 66, Issue 1
> *****************************************
>
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2011-02-01