Re: Git is not scalable with too many refs/*

From: Michael Haggerty <mhagger@alum.mit.edu>
Date: Sep 26, 2011, 15:32 UTC
Message-ID: <4E809AFE.6010901@alum.mit.edu>
In-Reply-To: <201109251443.28243.mfick@codeaurora.org>

On 09/25/2011 10:43 PM, Martin Fick wrote:

Show 13 quoted lines

> A coworker of mine pointed out to me that a simple
> 
>   git checkout 
> 
> can also take rather long periods of time > 3 mins when run 
> on a repo with ~100K refs.  
> 
> While this is not massive like the other problem I reported, 
> it still seems like it is more than one would expect.  So, I 
> tried an older version of git, and to my surprise/delight, 
> it was much faster (.2s).  So, I bisected this issue also, 
> and it seems that the "offending" commit is 
> 680955702990c1d4bfb3c6feed6ae9c6cb5c3c07:

I'm still working on changes to store references hierarchically in the cache and read them lazily. I hope that it will help some scaling problems with large number of refs.

Unfortunately I keep getting tangled up in side issues, so it is taking a lot longer than expected. But there's still hope.

Michael

-- 
Michael Haggerty
mhagger@alum.mit.edu
http://softwareswirl.blogspot.com/