git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC/PATCH 0/3] Teach builtin-clone to pack refs

From
Johan Herland <johan@herland.net>
Date
Mar 23, 2008, 09:49 UTC
Message-ID
<200803231049.20874.johan@herland.net>
In-Reply-To
<7v8x0agtdn.fsf@gitster.siamese.dyndns.org>
On Sunday 23 March 2008, Junio C Hamano wrote:
Show 9 quoted lines
> Johan Herland <johan@herland.net> writes:
> 
> > Although most of the speedup from current "next" is achieved by the
> > builtin-clone work, there is still a considerable additional improvement
> > from writing all refs to a single file instead of writing one file per
> > ref. I expect the performance improvement to be much bigger on platforms
> > with slower filesystem (aka. Windows).
> 
> At some point, additional speedups are hidden in the noise.
Yes, however, I bet you'll notice the difference between writing 11000 files on Windows, and writing 1.
Unfortunately, this scenario is not as far fetched as some may think: At $dayjob I'm working on converting old CVS modules with up to ~10 years of history, and some of the resulting repos have ~30000 refs (mostly build tags). Although I'll probably remove the build tags before preparing the repos that most other developers will see, I'll still have to keep the build tags around somewhere, in case devs need to refer to them. And, of course, most devs are still Windows-users. Keeping refs packed is pretty much crucial in this scenario.
> Not writing reflogs is a _different_ behaviour from the previous, but I
> suspect it might even be an improvement.  When you have 1000 remote
> branches, probably most of them are not even active.
Exactly my thinking as well. And for those few that _are_ active, you'll still of course get regular reflog entries when they _do_ change.
...Johan
-- 
Johan Herland, <johan@herland.net>
www.herland.net
Previous: Junio C Hamano
Message 13 of 13 in “Teach builtin-clone to pack refs”
  1. 0/3 Teach builtin-clone to pack refsJohan Herland, Mar 22, 2008
  2. 1/3 Move pack_refs() and friends into libgitJohan Herland, Mar 22, 2008
  3. 2/3 Prepare testsuite for a "git clone" that packs refsJohan Herland, Mar 22, 2008
  4. Daniel BarkalowApr 14, 2008
  5. Johan HerlandApr 14, 2008
  6. 1/4 Incorporate fetched packs in future object traversalJohan Herland, Apr 14, 2008
  7. 2/4 Move pack_refs() and friends into libgitJohan Herland, Apr 14, 2008
  8. 3/4 Prepare testsuite for a "git clone" that packs refsJohan Herland, Apr 14, 2008
  9. 4/4 Teach "git clone" to pack refsJohan Herland, Apr 14, 2008
  10. 3/3 Teach "git clone" to pack refsJohan Herland, Mar 22, 2008
  11. Daniel BarkalowMar 22, 2008
  12. Junio C HamanoMar 23, 2008
  13. Johan HerlandMar 23, 2008

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.