git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: pack-object poor performance (with large number of objects?)

From
Jeff King <peff@peff.net>
Date
Oct 4, 2011, 11:07 UTC
Message-ID
<20111004110702.GA18599@sigill.intra.peff.net>
In-Reply-To
<CAA01CsoSTsBLNcbv5o6Jx6YrjG4g8T=yodX811ymBLXg7sjDJQ@mail.gmail.com>
On Tue, Oct 04, 2011 at 09:59:08AM +0200, Piotr Krukowiecki wrote:
Show 6 quoted lines
> I've run the command and it took about 20 minutes in "Counting
> objects" to count up to 500000 on idle machine and there's still 700MB
> RAM free.
> [...]
> So it looks it's not a problem with git but rather with my disk/file
> system/linux...

You mentioned that git was in the 'D' state earlier. And it sounds like you have 1.7 million objects, _completely_ unpacked.

So my guess is that it is simply taking an enormous amount of disk space, and git is mostly waiting on the disk to read in files. What does "du -sh .git/objects" say?

-Peff
Previous: Piotr KrukowieckiNext: Piotr Krukowiecki
Message 6 of 11 in “pack-object poor performance (with large number of objects?)”
  1. Piotr KrukowieckiOct 3, 2011
  2. Shawn PearceOct 3, 2011
  3. Piotr KrukowieckiOct 3, 2011
  4. Junio C HamanoOct 3, 2011
  5. Piotr KrukowieckiOct 4, 2011
  6. Jeff KingOct 4, 2011
  7. Piotr KrukowieckiOct 4, 2011
  8. Jeff KingOct 4, 2011
  9. Piotr KrukowieckiOct 4, 2011
  10. Jeff KingOct 4, 2011
  11. Piotr KrukowieckiOct 5, 2011

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.