On Tue, Aug 19, 2008 at 12:20:25AM -0500, Andy Tsouladze wrote:
> I know this. Please look at my reasoning, and if it is not convincing,
> feel free to remove this part.
>
> 1. Consider my original problem. After successful test 298, next lines I
> saw on my terminal were:
>
> test 298...OK (292 out of 445, remaining: 01:00)
> stunnel exited with 16777215!
> RUN: failed to start the HTTPS server
> test 350...FAILED
>
> Naturally, my assumption was that test 350 failed _because_ of stunnel,
> which was not the case. With "SKIPPED" enabled, I would have seen
>
> test 298...OK (292 out of 445, remaining: 01:00)
> stunnel exited with 16777215!
> RUN: failed to start the HTTPS server
> test 300...SKIPPED
> test 301...SKIPPED
> test 302...SKIPPED
> test 303...SKIPPED
> test 304...SKIPPED
> test 305...SKIPPED
> test 306...SKIPPED
> test 307...SKIPPED
> test 308...SKIPPED
> test 309...SKIPPED
> test 350...FAILED
>
> This would have tipped me to the fact that stunnel failure was part of
> test 300 and not 350.

This is exactly what you would have seen if you had not used the -s option.
The assumption you made, while understandable, was wrong. In a case like
this, I would have not only removed the -s option, but added -v and -d as
well to get the maximum debugging output I could while trying to track the
problem.

> 2. It keeps counting correct. With many skipped tests, test count (in
> parentheses) also skips. IMHO, a short "SKIPPED" is nicer ;)

This is quite annoying when running just a handful of tests. In that case,
there are two or test XYZ...OK lines hidden amongst hundreds and hundreds of
test ABC...SKIPPED lines. That's one example where -s is working as
designed.

>>> Dan

-- 
http://www.MoveAnnouncer.com              The web change of address service
          Let webmasters know that your web site has moved
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html