Re: 16 gig, 350,000 file repository

From: Nicolas Pitre <nico@fluxnic.net>
Date: Feb 18, 2010, 20:58 UTC
Message-ID: <alpine.LFD.2.00.1002181556320.1946@xanadu.home>
In-Reply-To: <19325.40682.729141.973125@blake.zopyra.com>

On Thu, 18 Feb 2010, Bill Lear wrote:

Show 7 quoted lines

> I'm starting a new, large project and would like a quick bit of advice.
> 
> Bringing in a set of test cases and other files from a ClearCase
> repository resulted in a 350,000 file git repo of about 16 gigabytes.
> 
> The time to clone over a fast network was about 250 minutes.  I could
> not verify if the repo had been packed properly, etc.

I'd start from there. If you didn't do a 'git gc --aggressive' after the import then it is quite likely that your repo isn't well packed.

Of course you'll need a big machine to repack this. But that should be needed only once.

Nicolas

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.