Re: Big project, slow access!

From: Nicolas Pitre <nico@fluxnic.net>
Date: Sep 18, 2009, 19:02 UTC
Message-ID: <alpine.LFD.2.00.0909181455580.24133@xanadu.home>
In-Reply-To: <ffb2c0280909181138r7fde8722n80be4bdf95864c37@mail.gmail.com>

On Fri, 18 Sep 2009, Toan Pham wrote:

Show 8 quoted lines

> Hi,
> 
> I use git to maintain a project that is at least 8 gigs in size.
> The project is a Linux from Scratch repository that includes source
> codes to approximately 2000 open source projects,
> gcc tool-chain, 1000+ configurations for different software packages,
> source code for different kernel versions,
> and many linux distributions/flavors resulted from this LFS build environment.

How did you organize things in your repository?

Show 5 quoted lines

> The git's object repository is now 4.6 gigs and consists of approx.
> 610,000 files and folders.
> The speed of git is now terribly slow.  Each time I use basic commands
> like 'git status' or 'git diff',
> it would take at least 5 minutes for git to give me back a result.

Did you repack your repository?  If so, what parameter did you use?

> Again, the machine that i run git on is a P4 3.2 gig-hertz with HT.

If so you'll have problems repacking your repository. You'd need a 64-bit machine with enough RAM to be able to make the repository fully packed, so it might then be tight enough to fit more confortably on a 32-bit machine afterwards.

> would  someone please recommend on how i can optimize git's performance?
> Git is so slow, are there better ways to manage a project like this?

You could have a look at submodule support.

Nicolas