Re: Is MacOS CI flaky?

From: Junio C Hamano <gitster@pobox.com>
Date: Jun 16, 2023, 23:44 UTC
Message-ID: <xmqqjzw3rn07.fsf@gitster.g>
In-Reply-To: <kl6lilbnrrl1.fsf@chooglen-macbookpro.roam.corp.google.com>

Glen Choo <chooglen@google.com> writes:

Show 14 quoted lines

> 1. https://github.com/chooglen/git/actions/runs/5294136258
>
> is just
>
> 2. https://github.com/chooglen/git/actions/runs/5292953535
>
> with a fix for "win build", but 2. also failed for completely unrelated
> reasons on osx-*.
>
> Casually clicking through https://github.com/git/git/actions/ suggests
> that others might be experiencing similar failures too?
>
> - https://github.com/git/git/actions/runs/5293250265
> - https://github.com/git/git/actions/runs/5289074140

One of the above two is a topic that mucks with credential seeing a failure in http test, so I would not be surprised if the topic adds a test that does not pass on macOS. Its breakage does seem somewhat similar to what you are getting. I didn't check what the above topic of yours is doing---maybe it is not touching http codepath and/or the http tests at all? If that is the case, I would not be surprised if the existing test is flaky.

The other one is failing tests with p4, which I saw is flaky and fails to bring up or tear down p4 environment for testing. I usually ignore them when I am watching the post-push tests, unless at a major milestone, in which case I'd "Re-run failed jobs" and sometimes the breakage goes away (i.e. the failure is flake).

Thanks.