threads / discuss / 24800

Out of memory error during git push

Subject: Out of memory error during git push

## tl;dr

8 messages between Aug 20, 2010 and Aug 20, 2010.

replies: 7people: 3as markdown or json

Thomas Jampen· Aug 20, 2010, 09:11 UTC · lore

Hi all

I'm experiencing the following error while pushing a git repo (home directory) to my QNAP TS-210:

user@mypc:~$ git push origin master Counting objects: 12532, done. Delta compression using up to 2 threads. Compressing objects: 100% (8974/8974), done. fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s error: pack-objects died of signal 13 error: pack-objects died with strange error error: failed to push some refs to 'ssh://nas//share/MD0_DATA/user/repositories/backup.mypc'

I've searched the internet and found suggestions to try to repack with lower values for 'depth', 'window' and 'windowMemory'. I used 3, 3, 50 respectively, but a push after the repack command resulted in the same error.

I tried git fsck which reported a few dangling blobs only and I got the same error again during the next push.

I watched /proc/meminfo and /proc/swaps on the NAS while pushing and saw that there are always 20-50MB of free RAM and that from 512MB swap space only about 180MB are used.

What else can I try to successfully push my repo to my NAS?

Thanks for your help, Tom

Jonathan Nieder· Aug 20, 2010, 12:51 UTC · re: Thomas Jampen · lore

Re: Out of memory error during git push

(+cc: Nicolas, who knows the packing code pretty well)

Hi,

Thomas Jampen wrote:

Show 9 quoted lines

> I'm experiencing the following error while pushing a git repo (home
> directory) to my QNAP TS-210:
> 
> user@mypc:~$ git push origin master
> Counting objects: 12532, done.
> Delta compression using up to 2 threads.
> Compressing objects: 100% (8974/8974), done.
> fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
> error: pack-objects died of signal 13

What version of git are you using? Do you have overcommit accounting enabled?

I am not sure this is the problem you are running into, but pack-objects like many other parts of git uses mmap() to read packfiles, which can make the address space usage high.

Show 11 quoted lines

> I've searched the internet and found suggestions to try to repack with
> lower values for 'depth', 'window' and 'windowMemory'. I used 3, 3, 50
> respectively, but a push after the repack command resulted in the same
> error.
> 
> I tried git fsck which reported a few dangling blobs only and I got the
> same error again during the next push.
> 
> I watched /proc/meminfo and /proc/swaps on the NAS while pushing and saw
> that there are always 20-50MB of free RAM and that from 512MB swap space
> only about 180MB are used.

I don't know --- this is out of my depth. :)

Good luck, Jonathan

Thomas Jampen· Aug 20, 2010, 14:26 UTC · re: Jonathan Nieder · lore

Re: Out of memory error during git push

Hi

Show 12 quoted lines

>> I'm experiencing the following error while pushing a git repo (home
>> directory) to my QNAP TS-210:
>>
>> user@mypc:~$ git push origin master
>> Counting objects: 12532, done.
>> Delta compression using up to 2 threads.
>> Compressing objects: 100% (8974/8974), done.
>> fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
>> error: pack-objects died of signal 13
> 
> What version of git are you using?  Do you have overcommit accounting
> enabled?

I'm using git version 1.7.0.4 on my Kubuntu 10.04 Laptop and git version 1.7.1.1 on my QNAP NAS.

On my Laptop and on the NAS, when I execute: sudo sysctl vm.overcommit_memory I get: vm.overcommit_memory = 0

Do you propose to set this to '2' in order to disable overcommitting? If yes, where (on the Laptop and/or on the NAS)?

Thanks, Tom

Jonathan Nieder· Aug 20, 2010, 14:50 UTC · re: Thomas Jampen · lore

Re: Out of memory error during git push

Thomas Jampen wrote:

> vm.overcommit_memory = 0
> 
> Do you propose to set this to '2' in order to disable overcommitting?

It might be interesting to try

 echo 1 >/proc/sys/vm/overcommit_memory

but 0 is generally the only sane setting.

Thomas Jampen· Aug 20, 2010, 16:01 UTC · re: Jonathan Nieder · lore

Re: Out of memory error during git push

Show 10 quoted lines

> > vm.overcommit_memory = 0
> >
> > Do you propose to set this to '2' in order to disable
> > overcommitting?
> 
> It might be interesting to try
> 
> echo 1 >/proc/sys/vm/overcommit_memory
> 
> but 0 is generally the only sane setting.

I set the value on both (Laptop and NAS) and got the following error: Counting objects: 13051, done. Delta compression using up to 2 threads. warning: suboptimal pack - out of memory Compressing objects: 100% (9848/9848), done. error: index-pack died of signal 9), 1.27 GiB | 308 KiB/s error: pack-objects died of signal 13 error: pack-objects died with strange error error: failed to push some refs to 'ssh://...'

Any ideas? Tom

Nicolas Pitre· Aug 20, 2010, 17:26 UTC · re: Jonathan Nieder · lore

Re: Out of memory error during git push

On Fri, 20 Aug 2010, Jonathan Nieder wrote:

Show 11 quoted lines

> Thomas Jampen wrote:
> 
> > vm.overcommit_memory = 0
> > 
> > Do you propose to set this to '2' in order to disable overcommitting?
> 
> It might be interesting to try
> 
>  echo 1 >/proc/sys/vm/overcommit_memory
> 
> but 0 is generally the only sane setting.

Don't know the meaning for specific values, but you definitively don't want to turn off memory overcommit.

Nicolas

Nicolas Pitre· Aug 20, 2010, 20:59 UTC · re: Jonathan Nieder · lore

Re: Out of memory error during git push

On Fri, 20 Aug 2010, Jonathan Nieder wrote:

Show 15 quoted lines

> (+cc: Nicolas, who knows the packing code pretty well)
> 
> Hi,
> 
> Thomas Jampen wrote:
> 
> > I'm experiencing the following error while pushing a git repo (home
> > directory) to my QNAP TS-210:
> > 
> > user@mypc:~$ git push origin master
> > Counting objects: 12532, done.
> > Delta compression using up to 2 threads.
> > Compressing objects: 100% (8974/8974), done.
> > fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
> > error: pack-objects died of signal 13

How much memory is there on the machine where the pushed data is going?

Nicolas

Thomas Jampen· Aug 20, 2010, 21:21 UTC · re: Nicolas Pitre · lore

Re: Out of memory error during git push

On 20.08.2010 22:59, Nicolas Pitre wrote:

Show 19 quoted lines

> On Fri, 20 Aug 2010, Jonathan Nieder wrote:
> 
>> (+cc: Nicolas, who knows the packing code pretty well)
>>
>> Hi,
>>
>> Thomas Jampen wrote:
>>
>>> I'm experiencing the following error while pushing a git repo (home
>>> directory) to my QNAP TS-210:
>>>
>>> user@mypc:~$ git push origin master
>>> Counting objects: 12532, done.
>>> Delta compression using up to 2 threads.
>>> Compressing objects: 100% (8974/8974), done.
>>> fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
>>> error: pack-objects died of signal 13
> 
> How much memory is there on the machine where the pushed data is going?

My NAS has 256MB RAM. While the push is running, there is between 20-50MB RAM available according to MemFree reported by 'head /proc/meminfo'. The harddrive space should not be an issue, its about 2TB.