{"thread":{"id":"32994","subject":"Load testing of git","startedAt":"2013-02-24T12:54:34Z","lastAt":"2013-03-05T22:04:28Z","messageCount":5,"participants":["Yuri Mikhailov","Thomas Koch","Jeff Epler","Shawn Pearce"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"210179","messageId":"CAGjB8pR+uByiJJikBXbaxUZO4rDgyfvJ31agxaQuWrMwSS1N7Q@mail.gmail.com","threadId":"32994","inReplyTo":null,"subject":"Load testing of git","fromName":"Yuri Mikhailov","fromEmail":"yuri.mikhaylov@gmail.com","sentAt":"2013-02-24T12:54:34Z","receivedAt":"2013-02-24T12:54:34Z","isPatch":false,"sender":{"key":"yuri.mikhaylov@gmail.com","avatar":null},"body":"Dear Git community,\n\nI am a Software Developer and I have been using git for a while.\nCurrently my company is looking for a version control system to use\nand we find Git a good candidate for us. But what is important for us\nto know is scalability of this VCS. Does anyone performed load testing\nof Git? What is the practical maximum number of files and revisions\nthis system can handle?\n\nBest regards,\nIurii Mykhailov\n"},{"id":"210186","messageId":"201302241758.18316.thomas@koch.ro","threadId":"32994","inReplyTo":"CAGjB8pR+uByiJJikBXbaxUZO4rDgyfvJ31agxaQuWrMwSS1N7Q@mail.gmail.com","subject":"Re: Load testing of git","fromName":"Thomas Koch","fromEmail":"thomas@koch.ro","sentAt":"2013-02-24T16:58:16Z","receivedAt":"2013-02-24T16:58:16Z","isPatch":false,"sender":{"key":"thomas@koch.ro","avatar":null},"body":"Yuri Mikhailov:\n> Dear Git community,\n> \n> I am a Software Developer and I have been using git for a while.\n> Currently my company is looking for a version control system to use\n> and we find Git a good candidate for us. But what is important for us\n> to know is scalability of this VCS. Does anyone performed load testing\n> of Git? What is the practical maximum number of files and revisions\n> this system can handle?\n> \n> Best regards,\n> Iurii Mykhailov\n\nHave a look at the projects using Git[1]. There are for sure projects that \nexceeds the scalability you're thinking about. The linux Kernel might be the \nbiggest project.\n\n[1] https://git.wiki.kernel.org/index.php/GitProjects\n\nThomas Koch, http://www.koch.ro\n"},{"id":"210188","messageId":"20130224175427.GA4691@unpythonic.net","threadId":"32994","inReplyTo":"CAGjB8pR+uByiJJikBXbaxUZO4rDgyfvJ31agxaQuWrMwSS1N7Q@mail.gmail.com","subject":"Re: Load testing of git","fromName":"Jeff Epler","fromEmail":"jepler@unpythonic.net","sentAt":"2013-02-24T17:54:28Z","receivedAt":"2013-02-24T17:54:28Z","isPatch":false,"sender":{"key":"jepler@unpythonic.net","avatar":"https://avatars.githubusercontent.com/u/1517291?v=4"},"body":"In 2012 there was a thread about git's performance on large\nrepositories. One archive of the discussion begins here:\nhttp://mid.gmane.org/CB5074CF.3AD7A%25joshua.redstone%40fb.com\n\n> The test repo has 4 million commits, linear history and about 1.3\n> million files.\n\nI'm not sure to what extent git performance may have changed since then,\ne.g., by improving the index format.\n\nJeff\n"},{"id":"210192","messageId":"CAJo=hJvX5rmsuB4Jsbp7ZoqeyPtB_fwiZc=8VMWmF=HN0XKGLw@mail.gmail.com","threadId":"32994","inReplyTo":"201302241758.18316.thomas@koch.ro","subject":"Re: Load testing of git","fromName":"Shawn Pearce","fromEmail":"spearce@spearce.org","sentAt":"2013-02-24T20:31:14Z","receivedAt":"2013-02-24T20:31:14Z","isPatch":false,"sender":{"key":"spearce@spearce.org","avatar":"https://avatars.githubusercontent.com/u/34844?v=4"},"body":"On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch wrote:\n> Yuri Mikhailov:\n>> Dear Git community,\n>>\n>> I am a Software Developer and I have been using git for a while.\n>> Currently my company is looking for a version control system to use\n>> and we find Git a good candidate for us. But what is important for us\n>> to know is scalability of this VCS. Does anyone performed load testing\n>> of Git? What is the practical maximum number of files and revisions\n>> this system can handle?\n>>\n>> Best regards,\n>> Iurii Mykhailov\n>\n> Have a look at the projects using Git[1]. There are for sure projects that\n> exceeds the scalability you're thinking about. The linux Kernel might be the\n> biggest project.\n\nI highly doubt the Linux kernel is the biggest project.\n\nIIRC WebKit has more objects, more files, etc. Its repository's\ncompressed form is >4G.\n\nI know of at least some proprietary repositories with 96G in them. Not\nmuch history, but a lot of binary blobs around 128M each doesn't\ncompress well. And bup wasn't used so we didn't get very good\ncompression over the files.\n"},{"id":"210663","messageId":"CAGjB8pT-HCDY-M7nP_YCGyyvAtVZnMYynm7rVypp66Ve2g-azA@mail.gmail.com","threadId":"32994","inReplyTo":"CAJo=hJvX5rmsuB4Jsbp7ZoqeyPtB_fwiZc=8VMWmF=HN0XKGLw@mail.gmail.com","subject":"Re: Load testing of git","fromName":"Yuri Mikhailov","fromEmail":"yuri.mikhaylov@gmail.com","sentAt":"2013-03-05T22:04:28Z","receivedAt":"2013-03-05T22:04:28Z","isPatch":false,"sender":{"key":"yuri.mikhaylov@gmail.com","avatar":null},"body":"Thanks to everyone. The information was useful.\n\nOn 24 February 2013 21:31, Shawn Pearce wrote:\n> On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch wrote:\n>> Yuri Mikhailov:\n>>> Dear Git community,\n>>>\n>>> I am a Software Developer and I have been using git for a while.\n>>> Currently my company is looking for a version control system to use\n>>> and we find Git a good candidate for us. But what is important for us\n>>> to know is scalability of this VCS. Does anyone performed load testing\n>>> of Git? What is the practical maximum number of files and revisions\n>>> this system can handle?\n>>>\n>>> Best regards,\n>>> Iurii Mykhailov\n>>\n>> Have a look at the projects using Git[1]. There are for sure projects that\n>> exceeds the scalability you're thinking about. The linux Kernel might be the\n>> biggest project.\n>\n> I highly doubt the Linux kernel is the biggest project.\n>\n> IIRC WebKit has more objects, more files, etc. Its repository's\n> compressed form is >4G.\n>\n> I know of at least some proprietary repositories with 96G in them. Not\n> much history, but a lot of binary blobs around 128M each doesn't\n> compress well. And bup wasn't used so we didn't get very good\n> compression over the files.\n"}]}