Re: [PATCH] travis-ci: run previously failed tests first, then slowest to fastest

From: brian m. carlson <sandals@crustytoothpaste.net>
Date: Jan 22, 2016, 02:33 UTC
Message-ID: <20160122023359.GA686558@vauxhall.crustytoothpaste.net>
In-Reply-To: <DBA834D2-BFC9-4A2F-94D9-A1D0D60377BD@gmail.com>

On Wed, Jan 20, 2016 at 10:22:16AM +0100, Lars Schneider wrote:

Show 12 quoted lines

> I tested different settings and found that running prove with "-j5" seems to be
> the fastest option for the Travis CI machines. However, I also noticed that
> I got more test failures with higher parallelism (Dscho reported similar
> observations [1]).
> 
> Especially t0025-crlf-auto.sh failed multiple times ([2], [3]) on the OS X builds
> when I increase the parallelism:
> 
> not ok 4 - text=true causes a CRLF file to be normalized
> not ok 9 - text=auto, autocrlf=true _does_ normalize CRLF files
> 
> Anyone an idea why that might be the case?

I've seen this on my personal box too[0] when running make -j4 all test. I wasn't able to pin down why it was occurring, but if we're going to run the tests in parallel, it's probably worth spending some time figuring it out.

[0] Debian amd64/sid, ThinkPad X220.

-- 
brian m. carlson / brian with sandals: Houston, Texas, US
+1 832 623 2791 | https://www.crustytoothpaste.net/~bmc | My opinion only
OpenPGP: RSA v4 4096b: 88AC E9B2 9196 305B A994 7552 F1BA 225C 0223 B187