Re: Achieving efficient storage of weirdly structured repos

From: Nicolas Pitre <nico@cam.org>
Date: Apr 7, 2008, 00:13 UTC
Message-ID: <alpine.LFD.1.00.0804062000240.2947@xanadu.home>
In-Reply-To: <20080406161003.GA24358@coredump.intra.peff.net>

On Sun, 6 Apr 2008, Jeff King wrote:

Show 10 quoted lines

> My thought was something like:
> 
>   - add a new object type, multiblob; a multiblob contains zero or more
>     "child" sha1s, each of which is another multiblob or a blob. The
>     data in the multiblob is an in-order concatenation of its children.
> 
>   - you would create multiblobs with a "smart" git-add that understands
>     the filetype and splits the file accordingly (in my case, probably a
>     chunk of headers and EXIF data, and then a chunk with the image
>     data).

Well, in your example, the large image part should already be common to many objects due to deltas if they're really the same: different objects will only have different EXIF data plus a delta reference to the same base image object. So in a way the split is already there. Needs only that some applications exploit this information at runtime.

Nicolas