git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Git server eats all memory

From
IKIvan Kanis <expire-by-2010-08-09@kanis.fr>
Date
Aug 4, 2010, 14:57 UTC
Message-ID
<wesfwyupgrg.fsf@kanis.fr>
Hello,

I am running git 1.7.0.4 on Debian stable. I have compiled git from source. I am cloning using ssh.The client and the server are running the same version. The bare repository is 4.5G with various binary files, I have 6G of memory on my server.

I am having problem with memory ballooning when receiving object from the server. The amount of memory used on the server seems to be same size as the object received.

I have been discussing this quite a bit on #git at freenode. Hilary said it was maybe due to file mmap that caused the memory reported on top to be skewed.

I have ran two clones side by side and noticed that the server started to swap and performance were awful. This means that if two developers are doing a clone at the same time they will notice the slowness.

Another worry is that we're planning to have more repositories of the same size and the server just won't scale.

I am wondering if anyone has seen this behavior? I'll do whatever I can to troubleshoot the problem. I know C but I just don't know where to look at. Any help would be very much appreciated.

Kind regards,
-- 
Ivan Kanis

Let a fool hold his tongue and he will pass for a sage.
    -- Publilius Syrus
Next: Matthieu Moy
Message 1 of 28 in “Git server eats all memory”
  1. Ivan KanisAug 4, 2010
  2. Matthieu MoyAug 4, 2010
  3. Ivan KanisAug 4, 2010
  4. Avery PennarunAug 4, 2010
  5. Ivan KanisAug 5, 2010
  6. Jared HanceAug 5, 2010
  7. Nguyen Thai Ngoc DuyAug 6, 2010
  8. Nguyen Thai Ngoc DuyAug 6, 2010
  9. Jakub NarebskiAug 6, 2010
  10. Ivan KanisAug 6, 2010
  11. Dmitry PotapovAug 7, 2010
  12. Excessive mmap [was Git server eats all memory]Ivan Kanis, Aug 9, 2010
  13. Dmitry PotapovAug 9, 2010
  14. Ivan KanisAug 9, 2010
  15. Avery PennarunAug 9, 2010
  16. Tomas CarneckyAug 9, 2010
  17. Avery PennarunAug 9, 2010
  18. Dmitry PotapovAug 9, 2010
  19. Ivan KanisAug 11, 2010
  20. Avery PennarunAug 11, 2010
  21. Duy NguyenJun 20, 2018
  22. Robin H. JohnsonAug 10, 2010
  23. Sverre RabbelierAug 10, 2010
  24. Sam VilainAug 11, 2010
  25. Ivan KanisAug 11, 2010
  26. Nguyen Thai Ngoc DuyAug 9, 2010
  27. Ivan KanisAug 9, 2010
  28. Dmitry PotapovAug 17, 2010

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.