git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Large repo and pack.packsizelimit

From
Jeff King <peff@peff.net>
Date
May 8, 2012, 21:20 UTC
Message-ID
<20120508212012.GA20044@sigill.intra.peff.net>
In-Reply-To
<alpine.LFD.2.02.1205081709010.21030@xanadu.home>
On Tue, May 08, 2012 at 05:13:13PM -0400, Nicolas Pitre wrote:
Show 8 quoted lines
> > This should be fixed in git. Unfortunately, I don't know that it is as
> > trivial as just splitting the incoming stream; we would also have to
> > make sure that there were no cross-pack deltas in the result.
> 
> IMHO this is the wrong fix.  The pack size limit was created to deal 
> with storage media with limited capacity.  In this case, the repack 
> process should be told to limit its memory usage, and pack-index should 
> simply be taught to cope.

Hmm, you're right. I was thinking it helped to deal with memory addressing issues for 32-bit systems, but I guess core.packedGitWindowSize should be handling that. IOW, the 10G packfile should work just fine for normal access.

However, the OP did say he got an "out of memory" error during the clone. So maybe there is a problem to be fixed in index-pack there.

-Peff
Previous: Nicolas PitreNext: Nicolas Pitre
Message 4 of 10 in “Large repo and pack.packsizelimit”
  1. th.acker66@arcor.deMay 3, 2012
  2. Jeff KingMay 8, 2012
  3. Nicolas PitreMay 8, 2012
  4. Jeff KingMay 8, 2012
  5. Nicolas PitreMay 8, 2012
  6. ThomasMay 9, 2012
  7. Nguyen Thai Ngoc DuyMay 9, 2012
  8. ThomasMay 9, 2012
  9. Junio C HamanoMay 9, 2012
  10. ThomasMay 10, 2012

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.