git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: "git grep" parallelism question

From
Junio C Hamano <gitster@pobox.com>
Date
Apr 29, 2013, 22:22 UTC
Message-ID
<7v1u9tgeov.fsf@alter.siamese.dyndns.org>
In-Reply-To
<20130429180857.GK472@serenity.lan>
John Keeping <john@keeping.me.uk> writes:
Show 27 quoted lines
> On Mon, Apr 29, 2013 at 08:04:10PM +0200, Thomas Rast wrote:
>> John Keeping <john@keeping.me.uk> writes:
>> 
>> > On Mon, Apr 29, 2013 at 07:35:01PM +0530, Ramkumar Ramachandra wrote:
>> >> On a related note, one place that IO parallelism can provide massive
>> >> benefits is in executing shell scripts.  Accordingly, I always use the
>> >> following commands to compile and test git respectively:
>> >> 
>> >>     make -j 8 CFLAGS="-g -O0 -Wall"
>> >>     make -j 8 DEFAULT_TEST_TARGET=prove GIT_PROVE_OPTS="-j 16" test
>> >> 
>> >> i.e. always use 8 threads when the task is known to be CPU intensive,
>> >> and always use 16 threads when the task is known to be IO intensive.
>> >
>> > On this tangent, I recently added a TEST_OUTPUT_DIRECTORY line to my
>> > config.mak which points into a tmpfs mount.  Keeping all of the test
>> > repositories in RAM makes the tests significantly faster for me and
>> > works nicely when you have the patches in jk/test-output (without those
>> > patches the individual tests work but the reporting of aggregate results
>> > doesn't).
>> 
>> But that's been possible for quite some time now, using --root, or am I
>> missing something?
>
> No, I was the one missing something (--root to be precise).  But with
> TEST_OUTPUT_DIRECTORY you also get the result files in your temporary
> location, not just the trash directory.
With your patch, doesn't "tXXXX-*.sh --root $there" automatically
use the fast $there temporary location as the result depot, too?
If it doesn't with the current code, shouldn't it?
 
Previous: John KeepingNext: John Keeping
Message 11 of 16 in “"git grep" parallelism question”
  1. Linus TorvaldsApr 26, 2013
  2. Junio C HamanoApr 26, 2013
  3. Linus TorvaldsApr 26, 2013
  4. Junio C HamanoApr 26, 2013
  5. Linus TorvaldsApr 26, 2013
  6. Thomas RastApr 27, 2013
  7. Ramkumar RamachandraApr 29, 2013
  8. John KeepingApr 29, 2013
  9. Thomas RastApr 29, 2013
  10. John KeepingApr 29, 2013
  11. Junio C HamanoApr 29, 2013
  12. John KeepingApr 30, 2013
  13. Jeff KingApr 30, 2013
  14. John KeepingApr 30, 2013
  15. Jeff KingApr 30, 2013
  16. Pete WyckoffMay 5, 2013

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.