git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: git fast-import leaks memory drastically, so crashes with out of memory by attempt to import 22MB export dump

From
Jeff King <peff@peff.net>
Date
Oct 15, 2020, 01:26 UTC
Message-ID
<20201015012636.GA387901@coredump.intra.peff.net>
In-Reply-To
<1eeb49305cb7c712e141dcae2c434d96@sebres.de>
On Wed, Oct 14, 2020 at 11:22:03AM +0200, Dipl. Ing. Sergey Brester wrote:
> I did not see any issues with (even much larger) imports, before I upgraded
> git to 2.28.0 (from 2.25.1, I guess).

I wasn't able to reproduce, but it sounds like there's something special about this repo (since the dump is not that big, and you said much larger dumps have succeeded).

Is it possible to make either the fossil repo, or the fast-import input file available?

If not, since you said it works with 2.14.4, is it possible to bisect in Git to see when it stopped working? You'll need to be able to build Git from source.

-Peff
Previous: Dipl. Ing. Sergey BresterNext: Dipl. Ing. Sergey Brester
Message 2 of 20 in “git fast-import leaks memory drastically, so crashes with out of memory by attempt to import 22MB export dump”
  1. Dipl. Ing. Sergey BresterOct 14, 2020
  2. Jeff KingOct 15, 2020
  3. Dipl. Ing. Sergey BresterOct 15, 2020
  4. fast-import: fix over-allocation of marks storageJeff King, Oct 15, 2020
  5. Junio C HamanoOct 15, 2020
  6. Junio C HamanoOct 15, 2020
  7. Dipl. Ing. Sergey BresterOct 15, 2020
  8. Junio C HamanoOct 15, 2020
  9. Jeff KingOct 15, 2020
  10. Junio C HamanoOct 15, 2020
  11. brian m. carlsonOct 16, 2020
  12. Jeff KingOct 15, 2020
  13. Jeff KingOct 15, 2020
  14. brian m. carlsonOct 16, 2020
  15. Jeff KingOct 16, 2020
  16. Dipl. Ing. Sergey BresterOct 15, 2020
  17. Junio C HamanoOct 15, 2020
  18. René ScharfeOct 15, 2020
  19. René ScharfeOct 15, 2020
  20. Dipl. Ing. Sergey BresterOct 15, 2020

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.