Re: [PATCH] RFC: git lazy clone proof-of-concept

From: Johannes Schindelin <johannes.schindelin@gmx.de>
Date: Feb 10, 2008, 16:43 UTC
Message-ID: <alpine.LSU.1.00.0802101640570.11591@racer.site>
In-Reply-To: <alpine.LFD.1.00.0802092200350.2732@xanadu.home>

Hi,

On Sat, 9 Feb 2008, Nicolas Pitre wrote:

Show 18 quoted lines

> On Sat, 9 Feb 2008, Jan Holesovsky wrote:
> 
> > On Friday 08 February 2008 20:00, Jakub Narebski wrote:
> > 
> > > Both Mozilla import, and GCC import were packed below 0.5 GB. Warning:
> > > you would need machine with large amount of memory to repack it
> > > tightly in sensible time!
> > 
> > As I answered elsewhere, unfortunately it goes out of memory even on 8G 
> > machine (x86-64), so...  But still trying.
> 
> Try setting the following config variables as follows:
> 
> 	git config pack.deltaCacheLimit 1
> 	git config pack.deltaCacheSize 1
> 	git config pack.windowMemory 1g
> 
> That should help keeping memory usage somewhat bounded.

I tried that:

$ git config pack.deltaCacheLimit 1 $ git config pack.deltaCacheSize 1 $ git config pack.windowMemory 2g $ #/usr/bin/time git repack -a -d -f --window=250 --depth=250 $ du -s objects/ 2548137 objects/ $ /usr/bin/time git repack -a -d -f --window=250 --depth=250 Counting objects: 2477715, done. fatal: Out of memory, malloc failed411764) Command exited with non-zero status 1 9356.95user 53.33system 2:38:58elapsed 98%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (31929major+18088744minor)pagefaults 0swaps

Note that this is on a 2.4GHz Quadcode CPU with 3.5GB RAM.

I'm retrying with smaller values, but at over 2.5 hours per try, this is getting tedious.

Ciao, Dscho