git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Packfile can't be mapped

From
Shawn Pearce <spearce@spearce.org>
Date
Aug 29, 2006, 05:33 UTC
Message-ID
<20060829053312.GB24594@spearce.org>
In-Reply-To
<20060829045239.GB24479@spearce.org>
Shawn Pearce <spearce@spearce.org> wrote:
Show 9 quoted lines
> This tree delta version came out pretty good.  The pack with tree
> deltas is 874 MiB.  Quite a reduction in size.  fast-import takes
> about 20 minutes to convert its 20 GiB input file into this 874 MiB
> pack.  Producing the 20 GiB input file from the 3 GiB CVS ,v
> files takes about 4 hours with Jon's modified cvs2svn.
> 
> Jon has started a `git-repack -a -f` with aggressive depth and
> window sizes.  He estimated it may need another 2.5 hours to process.
> Hopefully I'll hear more details tomorrow.
I just heard from Jon:
> git-repack -a -f --window=50 --depth=5000
> 100% CPU for 60 minutes
> 1.2GB resident memory
> Final pack size is 451,203,363 bytes.

So with very agressive delta depth and window sizes git-repack took a while to run but came very close to the best packed size from previous Mozilla CVS import attempts. I think we'd still like to make the final historical pack smaller than that.

-- 
Shawn.
Previous: Shawn Pearce
Message 16 of 16 in “Packfile can't be mapped”
  1. Jon SmirlAug 28, 2006
  2. Shawn PearceAug 28, 2006
  3. Nicolas PitreAug 28, 2006
  4. Linus TorvaldsAug 28, 2006
  5. Shawn PearceAug 28, 2006
  6. Jon SmirlAug 28, 2006
  7. Nicolas PitreAug 28, 2006
  8. Jon SmirlAug 28, 2006
  9. Nicolas PitreAug 28, 2006
  10. Shawn PearceAug 28, 2006
  11. Nicolas PitreAug 28, 2006
  12. Shawn PearceAug 28, 2006
  13. Shawn PearceAug 28, 2006
  14. Nicolas PitreAug 28, 2006
  15. Shawn PearceAug 29, 2006
  16. Shawn PearceAug 29, 2006

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.