git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC/PATCH] Better control of the tests run by a test suite

From
Jeff King <peff@peff.net>
Date
Mar 24, 2014, 23:03 UTC
Message-ID
<20140324230304.GC17080@sigill.intra.peff.net>
In-Reply-To
<1395650987-5960-1-git-send-email-ilya.bobyr@gmail.com>
On Mon, Mar 24, 2014 at 01:49:44AM -0700, Ilya Bobyr wrote:
Show 11 quoted lines
> Here are some examples of how functionality added by the patch
> could be used.  In order to run setup tests and then only a
> specific test (use case 1) one can do:
> 
>     $ ./t0000-init.sh --run='1 2 25'
> 
> or:
> 
>     $ ./t0000-init.sh --run='<3 25'
> 
> ('<=' is also supported, as well as '>' and '>=').

I don't have anything against this in principle, but I suspect it will end up being a big pain to figure out which of the early tests are required to set up the state, and which are not. Having "<" makes specifying it easier, but you still have to read the test script to figure out which tests need to be run.

I wonder if it would make sense to "auto-select" tests that match a regex like "set.?up|create"? A while ago, Jonathan made a claim that this would cover most tests that are dependencies of other tests. I did not believe him, but looking into it, I recall that we did seem to have quite a few matching that pattern. If there were a good feature like this that gave us a reason to follow that pattern, I think people might fix the remainder

-Peff
Previous: Ilya BobyrNext: Junio C Hamano
Message 12 of 23 in “Better control of the tests run by a test suite”
  1. Better control of the tests run by a test suiteIlya Bobyr, Mar 24, 2014
  2. 1/3 test-lib: Document short options in t/READMEIlya Bobyr, Mar 24, 2014
  3. Ramsay JonesMar 24, 2014
  4. Ilya BobyrMar 24, 2014
  5. Junio C HamanoMar 25, 2014
  6. Ilya BobyrMar 27, 2014
  7. Junio C HamanoMar 27, 2014
  8. Junio C HamanoMar 28, 2014
  9. Eric SunshineMar 25, 2014
  10. 2/3 test-lib: tests skipped by GIT_SKIP_TESTS say soIlya Bobyr, Mar 24, 2014
  11. 3/3 test-lib: '--run' to run only specific testsIlya Bobyr, Mar 24, 2014
  12. Jeff KingMar 24, 2014
  13. Junio C HamanoMar 25, 2014
  14. Ilya BobyrMar 27, 2014
  15. Better control of the tests run by a test suiteIlya Bobyr, Mar 27, 2014
  16. 1/3 test-lib: Document short options in t/READMEIlya Bobyr, Mar 27, 2014
  17. 2/3 test-lib: tests skipped by GIT_SKIP_TESTS say soIlya Bobyr, Mar 27, 2014
  18. 3/3 test-lib: '--run' to run only specific testsIlya Bobyr, Mar 27, 2014
  19. Eric SunshineMar 28, 2014
  20. Ilya BobyrMar 28, 2014
  21. Eric SunshineMar 30, 2014
  22. Junio C HamanoMar 31, 2014
  23. David TranMar 31, 2014

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.