Re: Cygwin can't handle huge packfiles?

From: Nicolas Pitre <nico@cam.org>
Date: Apr 7, 2006, 14:11 UTC
Message-ID: <Pine.LNX.4.64.0604071002530.2215@localhost.localdomain>
In-Reply-To: <7vhd55ls24.fsf@assigned-by-dhcp.cox.net>

On Fri, 7 Apr 2006, Junio C Hamano wrote:

Show 16 quoted lines

> Linus Torvalds <torvalds@osdl.org> writes:
> 
> > On Mon, 3 Apr 2006, Linus Torvalds wrote:
> >> 
> >> That said, I think git _does_ have problems with large pack-files. We have 
> >> some 32-bit issues etc
> >
> > I should clarify that. git _itself_ shouldn't have any 32-bit issues, but 
> > the packfile data structure does. The index has 32-bit offsets into 
> > individual pack-files. 
> >
> > That's not hugely fundamental,...
> 
> Linus _does_ understand what he means, but let me clarify and
> outline a possible future direction.
>

[...]

For the record, the delta code also has 32-bit limitations of its own presently. It cannot encode a delta against a buffer which is larger than 4GB.

I however made sure the byte 0 could be used as a prefix for future encoding extensions, like 64-bit file offsets for example.

Nicolas