git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Calculating tree nodes

From
Andreas Ericsson <ae@op5.se>
Date
Sep 4, 2007, 15:14 UTC
Message-ID
<46DD7660.2030109@op5.se>
In-Reply-To
<9e4733910709040731s2695ab14kb9750923fcac007@mail.gmail.com>
Jon Smirl wrote:
Show 16 quoted lines
> On 9/4/07, Johannes Schindelin <Johannes.Schindelin@gmx.de> wrote:
>> Hi,
>>
>> On Tue, 4 Sep 2007, Jon Smirl wrote:
>>
>>> In my scheme the path info is moved into the file object nodes and the
>>> SHA list is in the commit node.
>> And how should this "SHA list" be any different from a single tree object,
>> except that you now merge it with the commit object?
>>
>> Really, go back to the mail Martin mentioned.  Having all objects in one
>> list kills performance.
> 
> You are ignoring the fact the in this scheme temp indexes can be
> created as needed. These temp indexes could look just like tree nodes.
> 

What's the cost associated with creating such an index? What are the estimated savings in size? What other performance penalties will git take due to this?

While I'm certainly interested in improving git (well, discussing its improvements anyway - I write too shabby code to participate fully), I fail to see how this scheme of storing things could help doing that, seeing as it's already the fastest SCM out there and does an insanely good job at storing large repositories packed up tight.

What you're proposing would effectively shave off ~4kb or so of stored data and save a *possible* disk access (note that there will most likely be none, as most users pack large repos, and for small ones it shouldn't matter much either way). The way you propose to do so involves fundamental and backwards-incompatible alterations to the very core of the git plumbing.

Yet you haven't shown a single estimate of how much diskspace would be saved, or what other gains are to be had, let alone any code to implement even a prototype of this new storage scheme.

Note that I'm currently in a state of mind where I'm feeling inclined to whoop and cheer at every small suggestion that sounds even the slightest bit of fun. No, I'm not doing drugs, but I just met the possible love of my life, got a big fat raise and my stocks just went ballistic. Someone less fortunate than I am right now is probably too bored to even argue against it.

> I'm saying that it may be a mistake to be recording the indexes (aka
> file names) as part of the commit when they really aren't.
But they are, since they're part of the snapshot.
> The
> essential part of the commit is the SHA1 list. The path names belong
> to the file objects and should be stored there.
> 

Sorry, but it'll take code and benchmarks to convince me this is a good idea. Not that it matters much what I think, but I've got an inkling Junio will need the same before he's swayed to your point of view.

-- 
Andreas Ericsson                   andreas.ericsson@op5.se
OP5 AB                             www.op5.se
Tel: +46 8-230225                  Fax: +46 8-230231
Previous: Johannes SchindelinNext: Martin Langhoff
Message 12 of 27 in “Calculating tree nodes”
  1. Jon SmirlSep 4, 2007
  2. Shawn O. PearceSep 4, 2007
  3. Jon SmirlSep 4, 2007
  4. Johannes SchindelinSep 4, 2007
  5. Jon SmirlSep 4, 2007
  6. Martin LanghoffSep 4, 2007
  7. Jon SmirlSep 4, 2007
  8. Andreas EricssonSep 4, 2007
  9. Johannes SchindelinSep 4, 2007
  10. Jon SmirlSep 4, 2007
  11. Johannes SchindelinSep 4, 2007
  12. Andreas EricssonSep 4, 2007
  13. Martin LanghoffSep 4, 2007
  14. Junio C HamanoSep 4, 2007
  15. Jon SmirlSep 4, 2007
  16. David TweedSep 4, 2007
  17. Jon SmirlSep 4, 2007
  18. Andreas EricssonSep 4, 2007
  19. Shawn O. PearceSep 4, 2007
  20. Jon SmirlSep 4, 2007
  21. Andreas EricssonSep 4, 2007
  22. David TweedSep 4, 2007
  23. Shawn O. PearceSep 4, 2007
  24. Junio C HamanoSep 4, 2007
  25. Shawn O. PearceSep 6, 2007
  26. Junio C HamanoSep 6, 2007
  27. Daniel HulmeSep 4, 2007

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.