From: Jeff Garzik Date: Sat, 25 Jun 2005 05:48:27 GMT Subject: Re: kernel.org and GIT tree rebuilding Message-ID: <42BCF02B.5090706@pobox.com> In-Reply-To: Linus Torvalds wrote: > > On Sat, 25 Jun 2005, Jeff Garzik wrote: > >>This is all due to the rsync sweeps, which have to scan metric tons of >>inodes and dentries. Orders of magnitude over the pre-git days. > > > Well, the real solution is to use a git-aware protocol, not rsync. > > rsync is wonderful for prototyping, and I wanted to make the database > rsync'able for that reason, but it clearly doesn't scale. > > I think I'll make a "pack"/"unpack" pair that just packs all the necessary > objects between two commits. Then you can basically sync the object file > by doing > > git-pack OLD..NEW | ssh other-end git-unpack > > and you'd basically be done. It looks pretty easy to do, too.. The problem is kernel.org mirroring, not individual pushes and pulls, really. Would git-pack be the best solution for mirroring a bunch of git trees? Jeff