git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: git gc --aggressive led to about 40 times slower "git log --raw"

From
David Kastrup <dak@gnu.org>
Date
Feb 19, 2014, 09:01 UTC
Message-ID
<87bny3qxwr.fsf@fencepost.gnu.org>
In-Reply-To
<CAGK7Mr4wpwUK6UF6vTmgszX4sajPDvQazY2QagFfH9BEJx_9Ow@mail.gmail.com>
Philippe Vaucher <philippe.vaucher@gmail.com> writes:
Show 6 quoted lines
>> fwiw this is the thread that added --depth=250
>>
>> http://thread.gmane.org/gmane.comp.gcc.devel/94565/focus=94626
>
> This post is quite interesting:
> http://article.gmane.org/gmane.comp.gcc.devel/94637

Yes. Of course I am prejudiced because I volunteered fixing git-blame on the Emacs developer list in order to make it more feasible to transfer the Emacs repository to Git.

Calling git blame via C-x v g is a rather important part of the workflow, and it's currently intolerable to work with on a number of files.

While I'm fixing the basic shortcomings in builtin/blame.c itself, the operation "fetch the objects" is necessary for all objects at least once. It's conceivable that some nice caching strategy would help with avoiding the repeated traversal of long delta chain tails. That could also help defusing the operation of basic stuff like git-log.

But the short and long end of it is that there are valid operations accessing a large amount of past history, and one point of having a distributed version control system with non-shallow repository by default is to have history and ways of working with it at one's hand.

And git's default modus of operation is _not_ to store things like copies and moves and renames in commits, but deduce them from looking at the stored data. So making looking at stored data including old data expensive means that Git does not work well in the way it is designed to operate.

-- 
David Kastrup
Previous: Philippe VaucherNext: Duy Nguyen
Message 11 of 31 in “git gc --aggressive led to about 40 times slower "git log --raw"”
  1. Christian JaegerFeb 18, 2014
  2. David KastrupFeb 18, 2014
  3. Duy NguyenFeb 18, 2014
  4. David KastrupFeb 18, 2014
  5. Jonathan NiederFeb 18, 2014
  6. Junio C HamanoFeb 18, 2014
  7. Duy NguyenFeb 18, 2014
  8. Junio C HamanoFeb 19, 2014
  9. Duy NguyenFeb 19, 2014
  10. Philippe VaucherFeb 19, 2014
  11. David KastrupFeb 19, 2014
  12. Duy NguyenFeb 19, 2014
  13. Duy NguyenFeb 19, 2014
  14. Christian JaegerFeb 20, 2014
  15. David KastrupFeb 20, 2014
  16. David KastrupFeb 20, 2014
  17. David KastrupFeb 20, 2014
  18. Junio C HamanoFeb 19, 2014
  19. Duy NguyenFeb 20, 2014
  20. Christian JaegerFeb 21, 2014
  21. Junio C HamanoFeb 21, 2014
  22. Duy NguyenFeb 21, 2014
  23. Junio C HamanoFeb 21, 2014
  24. Philippe VaucherFeb 24, 2014
  25. Duy NguyenFeb 22, 2014
  26. David KastrupFeb 22, 2014
  27. David KastrupFeb 22, 2014
  28. Duy NguyenFeb 22, 2014
  29. Duy NguyenFeb 22, 2014
  30. Andreas SchwabFeb 22, 2014
  31. Christian JaegerFeb 18, 2014

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.