Re: [kernel.org users] Re: auto-packing on kernel.org? please?

From: Daniel Barkalow <barkalow@iabervon.org>
Date: Oct 16, 2005, 15:44 UTC
Message-ID: <Pine.LNX.4.63.0510161122570.23242@iabervon.org>
In-Reply-To: <435264B1.2010204@de.bosch.com>

On Sun, 16 Oct 2005, Dirk Behme wrote:

Show 20 quoted lines

> > On Thu, 13 Oct 2005, Jeff Garzik wrote:
> >
> > >I have real users of my git repos who can't just download a 100MB pack file
> > >in
> > >an hour, it takes them many hours.
> 
> Seems that I'm one of these users (but using an other repo).
> 
> Pack files are very nice saving bandwith and disk space. But what I dislike is
> that I often have to download same information twice: Remote .git/objects/*
> repo grows and I update my local repo daily against this. Then once a
> month/release/whatever .git/objects/* are packed into one file. This new pack
> file then is downloaded as well, but most/all of the information in this file
> is already in my local repo and downloaded again. Something like
> 
> - detect that there is new pack file in remote repo
> - check what is in this remote pack file
> - if in local repo no or only few .git/objects/* are missing, download the
> missing ones and create an identical copy of remote pack file using local
> .git/objects/*. Don't download remote pack file.

This is the problem: it's impossible to download only a few objects from a pack file from an HTTP server, because those don't exist on the server as separate files.

The current HTTP code actually never downloads a pack file unless a needed object is not anywhere else, at which point it has no choice but to download the pack.

	-Daniel
*This .sig left intentionally blank*