# Load testing of git 5 messages from 2013-02-24 to 2013-03-05. Participants: Yuri Mikhailov, Thomas Koch, Jeff Epler, Shawn Pearce. Thread: https://gitlist.dev/t/32994 ## Yuri Mikhailov, 2013-02-24 12:54 Subject: Load testing of git Message-ID: URL: https://gitlist.dev/e/CAGjB8pR%2BuByiJJikBXbaxUZO4rDgyfvJ31agxaQuWrMwSS1N7Q%40mail.gmail.com ``` Dear Git community, I am a Software Developer and I have been using git for a while. Currently my company is looking for a version control system to use and we find Git a good candidate for us. But what is important for us to know is scalability of this VCS. Does anyone performed load testing of Git? What is the practical maximum number of files and revisions this system can handle? Best regards, Iurii Mykhailov ``` ## Thomas Koch, 2013-02-24 16:58 Subject: Re: Load testing of git Message-ID: <201302241758.18316.thomas@koch.ro> URL: https://gitlist.dev/e/201302241758.18316.thomas%40koch.ro In-Reply-To: ``` Yuri Mikhailov: > Dear Git community, > > I am a Software Developer and I have been using git for a while. > Currently my company is looking for a version control system to use > and we find Git a good candidate for us. But what is important for us > to know is scalability of this VCS. Does anyone performed load testing > of Git? What is the practical maximum number of files and revisions > this system can handle? > > Best regards, > Iurii Mykhailov Have a look at the projects using Git[1]. There are for sure projects that exceeds the scalability you're thinking about. The linux Kernel might be the biggest project. [1] https://git.wiki.kernel.org/index.php/GitProjects Thomas Koch, http://www.koch.ro ``` ## Jeff Epler, 2013-02-24 17:54 Subject: Re: Load testing of git Message-ID: <20130224175427.GA4691@unpythonic.net> URL: https://gitlist.dev/e/20130224175427.GA4691%40unpythonic.net In-Reply-To: ``` In 2012 there was a thread about git's performance on large repositories. One archive of the discussion begins here: http://mid.gmane.org/CB5074CF.3AD7A%25joshua.redstone%40fb.com > The test repo has 4 million commits, linear history and about 1.3 > million files. I'm not sure to what extent git performance may have changed since then, e.g., by improving the index format. Jeff ``` ## Shawn Pearce, 2013-02-24 20:31 Subject: Re: Load testing of git Message-ID: URL: https://gitlist.dev/e/CAJo%3DhJvX5rmsuB4Jsbp7ZoqeyPtB_fwiZc%3D8VMWmF%3DHN0XKGLw%40mail.gmail.com In-Reply-To: <201302241758.18316.thomas@koch.ro> ``` On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch wrote: > Yuri Mikhailov: >> Dear Git community, >> >> I am a Software Developer and I have been using git for a while. >> Currently my company is looking for a version control system to use >> and we find Git a good candidate for us. But what is important for us >> to know is scalability of this VCS. Does anyone performed load testing >> of Git? What is the practical maximum number of files and revisions >> this system can handle? >> >> Best regards, >> Iurii Mykhailov > > Have a look at the projects using Git[1]. There are for sure projects that > exceeds the scalability you're thinking about. The linux Kernel might be the > biggest project. I highly doubt the Linux kernel is the biggest project. IIRC WebKit has more objects, more files, etc. Its repository's compressed form is >4G. I know of at least some proprietary repositories with 96G in them. Not much history, but a lot of binary blobs around 128M each doesn't compress well. And bup wasn't used so we didn't get very good compression over the files. ``` ## Yuri Mikhailov, 2013-03-05 22:04 Subject: Re: Load testing of git Message-ID: URL: https://gitlist.dev/e/CAGjB8pT-HCDY-M7nP_YCGyyvAtVZnMYynm7rVypp66Ve2g-azA%40mail.gmail.com In-Reply-To: ``` Thanks to everyone. The information was useful. On 24 February 2013 21:31, Shawn Pearce wrote: > On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch wrote: >> Yuri Mikhailov: >>> Dear Git community, >>> >>> I am a Software Developer and I have been using git for a while. >>> Currently my company is looking for a version control system to use >>> and we find Git a good candidate for us. But what is important for us >>> to know is scalability of this VCS. Does anyone performed load testing >>> of Git? What is the practical maximum number of files and revisions >>> this system can handle? >>> >>> Best regards, >>> Iurii Mykhailov >> >> Have a look at the projects using Git[1]. There are for sure projects that >> exceeds the scalability you're thinking about. The linux Kernel might be the >> biggest project. > > I highly doubt the Linux kernel is the biggest project. > > IIRC WebKit has more objects, more files, etc. Its repository's > compressed form is >4G. > > I know of at least some proprietary repositories with 96G in them. Not > much history, but a lot of binary blobs around 128M each doesn't > compress well. And bup wasn't used so we didn't get very good > compression over the files. ```