Re: Dump http servers still slow?

From: Darrin Thompson <darrint@progeny.com>
Date: Jul 29, 2005, 14:03 UTC
Message-ID: <1122645821.4263.6.camel@localhost.localdomain>
In-Reply-To: <7vy87qpcwg.fsf@assigned-by-dhcp.cox.net>

On Thu, 2005-07-28 at 19:24 -0700, Junio C Hamano wrote:

Show 9 quoted lines

> The thing is, the base pack for the git repository is 1.8MB
> currently containing 4500+ objects, while we accumulated 600+
> unpacked objects since then which is about ~5MB.  The commit
> walker needs to fetched the latter one by one in the old way.
> 
> When packed incrementally on top of the base pack, these 600+
> unpacked objects compress down to something like 400KB, and I
> was hoping we could wait until we accumulate enough to produce
> an incremental about a meg or so ...

Ok... so lets check my assumptions:

1. Pack files should reduce the number of http round trips.
2. What I'm seeing when I check out mainline git is the acquisition of a
single large pack, then 600+ more recent objects. Better than before,
but still hundreds of round trips.
3. If I wanted to further speed up the initial checkout on my own
repositories I could frequently repack my most recent few hundred
objects.
4. If curl had pipelining then less pack management would be needed.

Where is the code for gitweb? (i.e. http://kernel.org/git ) Seems like it could benefit from some git-send-pack superpowers.

-- Darrin