git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH] t3419: drop EXPENSIVE tests

From
brian m. carlson <sandals@crustytoothpaste.net>
Date
Mar 22, 2020, 17:11 UTC
Message-ID
<20200322171111.GB6499@camp.crustytoothpaste.net>
In-Reply-To
<20200322075140.GA600888@coredump.intra.peff.net>
On 2020-03-22 at 07:51:40, Jeff King wrote:
Show 25 quoted lines
> When t3419 was originally written, it was designed to run a smaller test
> for correctness, and then the same test with a larger number of patches
> for performance. But it seems unlikely the latter was helping us:
> 
>  - it was marked with EXPENSIVE, so hardly anybody ran it anyway
> 
>  - there's no indication that it was more likely to find bugs than the
>    smaller case (the commit message isn't very helpful, but the original
>    cover letter describes it as: "The first patch adds correctness and
>    (optional) performance tests".
> 
>  - the timing results are shown only via test_debug(). So also not run
>    unless the user says "-d", and then not provided in any
>    machine-readable form.
> 
> If we're interested in performance regressions, a script in t/perf would
> be more appropriate. I didn't add one here, because it's not at all
> clear to me that what the script is timing is even all that interesting.
> 
> Let's simplify the script by dropping the EXPENSIVE run. That in turn
> lets us drop the do_tests() wrapper, which lets us consistently use
> single-quotes for our test snippets. And we can drop the useless
> test_debug() timings, as well as their run() helper. And finally, while
> we're here, we can replace the count() helper with the standard
> test_seq().

I'm also fine with this solution. As long as this test doesn't fail with EXPENSIVE, I'm happy.

-- 
brian m. carlson: Houston, Texas, US
OpenPGP: https://keybase.io/bk2204
Previous: Jeff KingNext: Jeff King
Message 7 of 8 in “t3419: prevent failure when run with EXPENSIVE”
  1. t3419: prevent failure when run with EXPENSIVEbrian m. carlson, Mar 20, 2020
  2. Elijah NewrenMar 20, 2020
  3. brian m. carlsonMar 20, 2020
  4. Junio C HamanoMar 20, 2020
  5. t3419: prevent failure when run with EXPENSIVEbrian m. carlson, Mar 20, 2020
  6. t3419: drop EXPENSIVE testsJeff King, Mar 22, 2020
  7. brian m. carlsonMar 22, 2020
  8. Jeff KingMar 22, 2020

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.