Re: git clone: very long "resolving deltas" phase

From: Vitaly Berov <vitaly.berov@gmail.com>
Date: Apr 9, 2010, 06:50 UTC
Message-ID: <4BBECE44.4040608@gmail.com>
In-Reply-To: <alpine.LFD.2.00.1004070842580.7232@xanadu.home>

Hi,

On 04/07/2010 04:55 PM, Nicolas Pitre wrote:

Show 13 quoted lines

>
> I was asking that because that would have helped me (or any other Git
> developer) analyse the issue and provide a fix.
>
> OK then.  What happens if you do the following on the server machine
> where the repository is stored:
>
> 	git repack -a -f -d
>
> How long does this take?
>
> How long does the "Resolving deltas" take when cloning this repacked
> repository? (don't wait more than 10 minutes for it).

Nicolas, we haven't stopped the process as you recommended, sorry for that.

So, the results: it took 37 hours. 20 hours is compressing objects (delta compression using up to 4 threads), 17 hours is writing objects. Almost all of the time the bottleneck was a CPU.

Objects amount: 3997548. Size of the repository: ~57Gb.

> If the "Resolving deltas" takes more than 10 minutes, could you capture
> a strace dump from that process during a minute or so and post it here?

I'll capture strace later.

> Hmmm. Is this on Linux or Windows?

Short spec: Ubuntu 9.04 (64 bit), Intel(R) Core(TM)2 Quad CPU Q8400 2.66GHz, 8 GB of memory

By the way, we have a large amount of binary files in our rep.

Vitaly