{"thread":{"id":"36268","subject":"Git server memory requirements","startedAt":"2014-03-21T17:38:01Z","lastAt":"2014-03-21T20:10:27Z","messageCount":2,"participants":["Cliff Brake","Robin H. Johnson"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"237329","messageId":"CAOd_LFwDQZGHo+gUhNKzvT2B8iavN_75KjwwC6P=W3z11d9zAw@mail.gmail.com","threadId":"36268","inReplyTo":null,"subject":"Git server memory requirements","fromName":"Cliff Brake","fromEmail":"cbrake@bec-systems.com","sentAt":"2014-03-21T17:38:01Z","receivedAt":"2014-03-21T17:38:01Z","isPatch":false,"sender":{"key":"cbrake@bec-systems.com","avatar":null},"body":"I'm trying to get an idea how much memory is required for a git server\nthat is hosting linux kernel repos.\n\nWhat we're seeing is that git uses around 1GB of RAM on the server\nwhen a user does a clone of the Linux kernel source over ssh.  Does\nthis seem about right?  Is this amount fixed, or arbitrary (trade-off\nmemory for speed).  It seems subsequent concurrent clones use less\nmemory.\n\nIs there any practical way to reduce the memory usage?  We're running\ninto occasional issues if there are multiple clones at once.\n\nIs setting gc.auto=0 a good idea for large kernel repos?  The idea is\nwe can repack manually or in a cron on weekends rather than during\nuser operations.  However, manually running a git gc seems to use\nabout as much memory as a user clone.\n\nIt may be that our EC2 small instance (2.5GB) is not up to the task,\nbut would like to understand options (we can easily trade off some\nspeed for less memory if we can) before upgrading.\n\nThanks,\nCliff\n"},{"id":"237356","messageId":"20140321201027.GA2858@orbis-terrarum.net","threadId":"36268","inReplyTo":"CAOd_LFwDQZGHo+gUhNKzvT2B8iavN_75KjwwC6P=W3z11d9zAw@mail.gmail.com","subject":"Re: Git server memory requirements","fromName":"Robin H. Johnson","fromEmail":"robbat2@gentoo.org","sentAt":"2014-03-21T20:10:27Z","receivedAt":"2014-03-21T20:10:27Z","isPatch":false,"sender":{"key":"robbat2@gentoo.org","avatar":"https://avatars.githubusercontent.com/u/373898?v=4"},"body":"On Fri, Mar 21, 2014 at 01:38:01PM -0400,  Cliff Brake wrote:\n> I'm trying to get an idea how much memory is required for a git server\n> that is hosting linux kernel repos.\nSpeaking for Gentoo here, as we're working on our large repo migration,\nand this was a concern originally. So far it's best mitigated by the\npack-bitmap patches in the next branch.\n\nThe initial clones become significantly faster and much less resource\nintensive.\n\nI'm hoping that the packed bitmap series lands soon in the master branch\nand a formal release (a big +1 from me for it).\n\n-- \nRobin Hugh Johnson\nGentoo Linux: Developer, Infrastructure Lead\nE-Mail     : robbat2@gentoo.org\nGnuPG FP   : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85\n"}]}