Dear Git community,
I am a Software Developer and I have been using git for a while. Currently my company is looking for a version control system to use and we find Git a good candidate for us. But what is important for us to know is scalability of this VCS. Does anyone performed load testing of Git? What is the practical maximum number of files and revisions this system can handle?
Best regards, Iurii Mykhailov
Re: Load testing of git
Yuri Mikhailov:
> Dear Git community, > > I am a Software Developer and I have been using git for a while. > Currently my company is looking for a version control system to use > and we find Git a good candidate for us. But what is important for us > to know is scalability of this VCS. Does anyone performed load testing > of Git? What is the practical maximum number of files and revisions > this system can handle? > > Best regards, > Iurii Mykhailov
Have a look at the projects using Git[1]. There are for sure projects that exceeds the scalability you're thinking about. The linux Kernel might be the biggest project.
[1] https://git.wiki.kernel.org/index.php/GitProjects
Thomas Koch, http://www.koch.ro
Shawn PearceRe: Load testing of git
On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch <thomas@koch.ro> wrote:
> Yuri Mikhailov: >> Dear Git community, >> >> I am a Software Developer and I have been using git for a while. >> Currently my company is looking for a version control system to use >> and we find Git a good candidate for us. But what is important for us >> to know is scalability of this VCS. Does anyone performed load testing >> of Git? What is the practical maximum number of files and revisions >> this system can handle? >> >> Best regards, >> Iurii Mykhailov > > Have a look at the projects using Git[1]. There are for sure projects that > exceeds the scalability you're thinking about. The linux Kernel might be the > biggest project.
I highly doubt the Linux kernel is the biggest project.
IIRC WebKit has more objects, more files, etc. Its repository's compressed form is >4G.
I know of at least some proprietary repositories with 96G in them. Not much history, but a lot of binary blobs around 128M each doesn't compress well. And bup wasn't used so we didn't get very good compression over the files.
Re: Load testing of git
Thanks to everyone. The information was useful.
On 24 February 2013 21:31, Shawn Pearce <spearce@spearce.org> wrote:
> On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch <thomas@koch.ro> wrote: >> Yuri Mikhailov: >>> Dear Git community, >>> >>> I am a Software Developer and I have been using git for a while. >>> Currently my company is looking for a version control system to use >>> and we find Git a good candidate for us. But what is important for us >>> to know is scalability of this VCS. Does anyone performed load testing >>> of Git? What is the practical maximum number of files and revisions >>> this system can handle? >>> >>> Best regards, >>> Iurii Mykhailov >> >> Have a look at the projects using Git[1]. There are for sure projects that >> exceeds the scalability you're thinking about. The linux Kernel might be the >> biggest project. > > I highly doubt the Linux kernel is the biggest project. > > IIRC WebKit has more objects, more files, etc. Its repository's > compressed form is >4G. > > I know of at least some proprietary repositories with 96G in them. Not > much history, but a lot of binary blobs around 128M each doesn't > compress well. And bup wasn't used so we didn't get very good > compression over the files.
Jeff EplerRe: Load testing of git
In 2012 there was a thread about git's performance on large repositories. One archive of the discussion begins here: http://mid.gmane.org/CB5074CF.3AD7A%25joshua.redstone%40fb.com
> The test repo has 4 million commits, linear history and about 1.3 > million files.
I'm not sure to what extent git performance may have changed since then, e.g., by improving the index format.
Jeff