git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: auto gc again

From
Nicolas Pitre <nico@cam.org>
Date
Mar 20, 2008, 03:13 UTC
Message-ID
<alpine.LFD.1.00.0803192228260.2947@xanadu.home>
In-Reply-To
<7vd4pq1el3.fsf@gitster.siamese.dyndns.org>
On Wed, 19 Mar 2008, Junio C Hamano wrote:
Show 13 quoted lines
> Nicolas Pitre <nico@cam.org> writes:
> 
> >On Wed, 19 Mar 2008, Junio C Hamano wrote:
> >
> >> I do not think "very tight" was the reason, but on the other hand, my
> >> personal feeling is that 20 was already 10 too many pack idx files we have
> >> to walk linearly while looking for objects at runtime.
> >
> > Since commit f7c22cc68ccb this is no longer such an issue.
> 
> Notice that I did not say "19 too many".  I know f7c22cc (always start
> looking up objects in the last used pack first, 2007-05-30) was meant to
> alleviate the situation, but isn't "no longer" a gross exaggeration?

Not at all. Please have a second look at the performance numbers in that commit log, and take into accound the most important metric that I unfortunately failed to mention there (although I subsequently posted it to the list: http://marc.info/?l=git&m=118058197921642&w=2), wich is the time to perform the same operation with a single pack.

So you have 17.1 seconds for a single pack vs 18.4 seconds for 66 packs.
Compare that to 24.9s without that patch.

And I still have some further optimizations to implement eventually (http://marc.info/?l=git&m=118062793413099&w=2), but which would probably make a significant difference only in the hundreds-of-packs case anyway.

So I really think that the default gc.autopacklimit could be raised.
Nicolas
Previous: Junio C HamanoNext: Junio C Hamano
Message 27 of 30 in “auto gc again”
  1. Jens AxboeMar 18, 2008
  2. Linus TorvaldsMar 18, 2008
  3. Jens AxboeMar 18, 2008
  4. Jens AxboeMar 18, 2008
  5. Linus TorvaldsMar 18, 2008
  6. Jens AxboeMar 18, 2008
  7. Johannes SchindelinMar 19, 2008
  8. Jens AxboeMar 19, 2008
  9. Johannes SchindelinMar 19, 2008
  10. Jens AxboeMar 20, 2008
  11. Nicolas PitreMar 19, 2008
  12. Jens AxboeMar 19, 2008
  13. Nicolas PitreMar 19, 2008
  14. Jens AxboeMar 20, 2008
  15. Junio C HamanoMar 20, 2008
  16. Jens AxboeMar 20, 2008
  17. Brandon CaseyMar 19, 2008
  18. builtin-gc.c: allow disabling all auto-gc'ing by assigning 0 to gc.autoBrandon Casey, Mar 19, 2008
  19. Teemu LikonenMar 20, 2008
  20. Nicolas PitreMar 19, 2008
  21. Jens AxboeMar 20, 2008
  22. Junio C HamanoMar 19, 2008
  23. Linus TorvaldsMar 19, 2008
  24. Junio C HamanoMar 19, 2008
  25. Nicolas PitreMar 19, 2008
  26. Junio C HamanoMar 19, 2008
  27. Nicolas PitreMar 20, 2008
  28. Junio C HamanoMar 20, 2008
  29. Nicolas PitreMar 20, 2008
  30. Junio C HamanoMar 20, 2008

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.