{"thread":{"id":"17819","subject":"Re: git-svn -- out of memory","startedAt":"2009-02-16T09:37:41Z","lastAt":"2009-02-16T13:45:06Z","messageCount":3,"participants":["Alfred M. Szmidt","Junio C Hamano","Jeff King"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"104919","messageId":"1234777061.090819.2512.nullmailer@beryx.hq.kred","threadId":"17819","inReplyTo":null,"subject":"Re: git-svn -- out of memory","fromName":"Alfred M. Szmidt","fromEmail":"ams@gnu.org","sentAt":"2009-02-16T09:37:41Z","receivedAt":"2009-02-16T09:37:41Z","isPatch":false,"sender":{"key":"ams@gnu.org","avatar":"https://gravatar.com/avatar/46825633bc1d168c418bbf90c7859b9f83888b45d7cc546a8544df495858df83?d=mp&s=160"},"body":"   > when doing a `git svn clone' on a subversion repository that contains\n   > a large file (>1GiB), `git svn' dies with the following:\n   > \n   > ams@trillian:~$ git svn clone REPO -T trunk -b branches -t tags\n   > [...]\n   > fatal: Out of memory? mmap failed: Cannot allocate memory\n   > hash-object -w --stdin-paths: command returned error: 128\n   > \n   > error closing pipe: Bad file descriptor at /usr/local/bin/libexec/git-core//git-svn line 0\n   > error closing pipe: Bad file descriptor at /usr/local/bin/libexec/git-core//git-svn line 0\n   > \n   > Doing a `git repack' doesn't help either.  Anyone got a clue how to\n   > either solve, or work around this?\n   > \n   > git version 1.6.1.3\n\n   Hi Alfred,\n\n   Core git requires objects to be able to fit into (virtual) memory.\n   Adding more swap space should solve the problem for you, but this is not\n   only a git-svn problem.\n\nIn this case, the machine has 32G RAM, including ~20G swap.  So I do\nnot think that this is the case, it could be I suppose...\n\nCheers.\n"},{"id":"104924","messageId":"7vhc2ubssd.fsf@gitster.siamese.dyndns.org","threadId":"17819","inReplyTo":"1234777061.090819.2512.nullmailer@beryx.hq.kred","subject":"Re: git-svn -- out of memory","fromName":"Junio C Hamano","fromEmail":"gitster@pobox.com","sentAt":"2009-02-16T10:05:54Z","receivedAt":"2009-02-16T10:05:54Z","isPatch":false,"sender":{"key":"gitster@pobox.com","avatar":"https://avatars.githubusercontent.com/u/54884?v=4"},"body":"\"Alfred M\\. Szmidt\" <ams@gnu.org> writes:\n\n>    > when doing a `git svn clone' on a subversion repository that contains\n>    > a large file (>1GiB), `git svn' dies with the following:\n>    > \n>    > ams@trillian:~$ git svn clone REPO -T trunk -b branches -t tags\n>    > [...]\n>    > fatal: Out of memory? mmap failed: Cannot allocate memory\n>    > hash-object -w --stdin-paths: command returned error: 128\n\nDing...\n\n>    > git version 1.6.1.3\n>\n>    Core git requires objects to be able to fit into (virtual) memory.\n>    Adding more swap space should solve the problem for you, but this is not\n>    only a git-svn problem.\n>\n> In this case, the machine has 32G RAM, including ~20G swap.  So I do\n> not think that this is the case, it could be I suppose...\n\nThe hash-object error message sounds like the issue that was fixed with\n915308b (avoid 31-bit truncation in write_loose_object, 2009-01-29).  Does\nv1.6.2-rc1 help?\n"},{"id":"104945","messageId":"20090216134506.GA20271@coredump.intra.peff.net","threadId":"17819","inReplyTo":"7vhc2ubssd.fsf@gitster.siamese.dyndns.org","subject":"Re: git-svn -- out of memory","fromName":"Jeff King","fromEmail":"peff@peff.net","sentAt":"2009-02-16T13:45:06Z","receivedAt":"2009-02-16T13:45:06Z","isPatch":false,"sender":{"key":"peff@peff.net","avatar":"https://avatars.githubusercontent.com/u/45925?v=4"},"body":"On Mon, Feb 16, 2009 at 02:05:54AM -0800, Junio C Hamano wrote:\n\n> \"Alfred M\\. Szmidt\" <ams@gnu.org> writes:\n> \n> >    > when doing a `git svn clone' on a subversion repository that contains\n> >    > a large file (>1GiB), `git svn' dies with the following:\n> >    > \n> >    > ams@trillian:~$ git svn clone REPO -T trunk -b branches -t tags\n> >    > [...]\n> >    > fatal: Out of memory? mmap failed: Cannot allocate memory\n> >    > hash-object -w --stdin-paths: command returned error: 128\n> \n> Ding...\n> [...]\n> The hash-object error message sounds like the issue that was fixed with\n> 915308b (avoid 31-bit truncation in write_loose_object, 2009-01-29).  Does\n> v1.6.2-rc1 help?\n\nHmm. The original problem I had with the 32-bit wrapping actually caused\nmalloc to fail, whereas this is an mmap failure. So it might not be the\nsame thing (but certainly testing with v1.6.2-rc1 will be a good data\npoint).\n\n-Peff\n"}]}