Re: pack-object poor performance (with large number of objects?)

From: Piotr Krukowiecki <piotr.krukowiecki@gmail.com>
Date: Oct 4, 2011, 12:22 UTC
Message-ID: <CAA01CsodyUQJOnj5vV0LdVEWpkvwSW2TAONzyY9J82o9VwC6Ag@mail.gmail.com>
In-Reply-To: <20111004110702.GA18599@sigill.intra.peff.net>

On Tue, Oct 4, 2011 at 1:07 PM, Jeff King <peff@peff.net> wrote:

Show 11 quoted lines

> On Tue, Oct 04, 2011 at 09:59:08AM +0200, Piotr Krukowiecki wrote:
>
>> I've run the command and it took about 20 minutes in "Counting
>> objects" to count up to 500000 on idle machine and there's still 700MB
>> RAM free.
>> [...]
>> So it looks it's not a problem with git but rather with my disk/file
>> system/linux...
>
> You mentioned that git was in the 'D' state earlier. And it sounds like
> you have 1.7 million objects, _completely_ unpacked.

That's right - since I had auto-gc disabled at first it had not chance to pack anything.

> So my guess is that it is simply taking an enormous amount of disk
> space, and git is mostly waiting on the disk to read in files. What does
> "du -sh .git/objects" say?

It isn't that big - it's 11G. .git/objects/pack/ is 666MB currently.

-- 
Piotr Krukowiecki