git/list[1] front-page[2] threads[3] people[4] search[5] about
 

fetch delta resolution vs. checkout (was: java zlib woes)

From
Andreas Krey <a.krey@gmx.de>
Date
Jun 4, 2013, 10:18 UTC
Message-ID
<20130604101836.GH22784@inner.h.apk.li>
In-Reply-To
<20130527041146.GJ9448@inner.h.apk.li>

On Mon, 27 May 2013 06:11:46 +0000, Andreas Krey wrote: ...

> 
> I now have a full test case (involving a generated repo just shy of 1GB)
> that will reproduce that hang. Will look up the existing jgit bug to
> report there.
On https://bugs.eclipse.org/bugs/show_bug.cgi?id=394078

A question: The delta decoding. If I understand correctly, git and jgit do verify the packfile content after fetching/cloning, and need to resolve any deltified files in the pack.

And when checking out a commit it needs this to again for the files that are being checked out?

Because we now have the phenomenon that the packfile is fetched ok, but a checkout then hangs (100%) CPU on one of the large files, and on one that should, according to core.bigfilethreshold, not even be deltified.

(Setting core.bigfilethreshold to 20m in the source repo (C git) gets jgit to no longer hang in the fetch/delta resolution phase. And it doesn't look like jgit would repack the pack file, and uses it as it was received plus 20 bytes at the end.)

Andreas
-- 
"Totally trivial. Famous last words."
From: Linus Torvalds <torvalds@*.org>
Date: Fri, 22 Jan 2010 07:29:21 -0800
Previous: Andreas KreyNext: Shawn Pearce
Message 12 of 19 in “Reading commit objects”
  1. Chico SokolMay 21, 2013
  2. Felipe ContrerasMay 21, 2013
  3. John SzakmeisterMay 21, 2013
  4. Chico SokolMay 21, 2013
  5. Junio C HamanoMay 21, 2013
  6. Chico SokolMay 21, 2013
  7. Jonathan NiederMay 21, 2013
  8. Shawn PearceMay 22, 2013
  9. java zlib woes (was: Reading commit objects)Andreas Krey, May 22, 2013
  10. Shawn PearceMay 22, 2013
  11. Andreas KreyMay 27, 2013
  12. fetch delta resolution vs. checkout (was: java zlib woes)Andreas Krey, Jun 4, 2013
  13. Shawn PearceMay 22, 2013
  14. Chico SokolMay 22, 2013
  15. Shawn PearceMay 22, 2013
  16. Chico SokolMay 22, 2013
  17. Chico SokolMay 22, 2013
  18. Shawn PearceMay 22, 2013
  19. Junio C HamanoMay 21, 2013

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.