curl / Mailing Lists / curl-library / Single Mail
Buy commercial curl support from WolfSSL. We help you work out your issues, debug your libcurl applications, use the API, port to new platforms, add new features and more. With a team lead by the curl founder himself.

Re: Tests and randomness

From: Frank Gevaerts via curl-library <curl-library_at_cool.haxx.se>
Date: Thu, 19 Dec 2019 12:56:03 +0100

On Thu, Dec 19, 2019 at 10:27:21AM +0100, Daniel Stenberg via curl-library wrote:
> The monthly seed thing is just the best way I've come up with that makes the
> random order semi-stable during development and testing of something but
> still changes it every now and then. I'm interested to learn if someone can
> come up with a better idea that perhaps can make it change slightly more
> frequently than each month...

Is there any way to keep state between runs? If so, and assuming test
failures tend to be fixed reasonably quicly, maybe only change the seed
if there are no failures? You'd probably still not want to change it at
every run even when no tests fail (test success can be as intermittent
as test failure), so maybe change it weekly or monthly whenever there
are no failures?

Frank

-- 
"Debugging is twice as hard as writing the code in the first place.
Therefore, if you write the code as cleverly as possible, you are,
by definition, not smart enough to debug it." - Brian W. Kernighan
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette:   https://curl.haxx.se/mail/etiquette.html
Received on 2019-12-19