Re: [PATCH] travis-ci: run previously failed tests first, then slowest to fastest

From: Jeff King <peff@peff.net>
Date: Jan 19, 2016, 19:12 UTC
Message-ID: <20160119191234.GA17562@sigill.intra.peff.net>
In-Reply-To: <1453195469-51696-1-git-send-email-larsxschneider@gmail.com>

On Tue, Jan 19, 2016 at 10:24:29AM +0100, larsxschneider@gmail.com wrote:

Show 7 quoted lines

> From: Lars Schneider <larsxschneider@gmail.com>
> 
> Use the Travis-CI cache feature to store prove test results and make them
> available in subsequent builds. This allows to run previously failed tests
> first and run remaining tests in slowest to fastest order. As a result it
> is less likely that Travis-CI needs to wait for a single test at the end
> which speeds up the test suite execution by ~2 min.

Thanks, this makes sense, and the patch looks good.

Show 6 quoted lines

> @@ -18,7 +22,7 @@ env:
>      - P4_VERSION="15.2"
>      - GIT_LFS_VERSION="1.1.0"
>      - DEFAULT_TEST_TARGET=prove
> -    - GIT_PROVE_OPTS="--timer --jobs 3"
> +    - GIT_PROVE_OPTS="--timer --jobs 3 --state=failed,slow,save"

Have you tried bumping --jobs here? I usually use "16" on my local box.

I also looked into the Travis "container" thing. It's not clear to me from their page:

  https://docs.travis-ci.com/user/workers/container-based-infrastructure/

whether we're using the new, faster container infrastructure or not. It depends on when Travis "recognized" the repo, but I'm not quite sure what that means. Should we be adding "sudo: false" to the top-level of the yaml file?

-Peff