16 gig, 350,000 file repository

From: Bill Lear <rael@zopyra.com>
Date: Feb 18, 2010, 20:11 UTC
Message-ID: <19325.40682.729141.973125@blake.zopyra.com>
In-Reply-To: <alpine.LFD.2.00.1002181456230.1946@xanadu.home>

I'm starting a new, large project and would like a quick bit of advice.

Bringing in a set of test cases and other files from a ClearCase repository resulted in a 350,000 file git repo of about 16 gigabytes.

The time to clone over a fast network was about 250 minutes. I could not verify if the repo had been packed properly, etc.

However, we are thinking of using submodules or subtrees, to allow a person to selectively clone only a part of the repo they need for their work. Is there a way to do this without submodules/subtrees?

We also need to be able to branch the entire repo, which I think would make submodules kind of a pain, but don't know...

What is the current thinking on these issues in the git community?

Bill

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.