Re: Historical kernel repository size

From: Linus Torvalds <torvalds@osdl.org>
Date: Sep 14, 2006, 15:31 UTC
Message-ID: <Pine.LNX.4.64.0609140824580.4388@g5.osdl.org>
In-Reply-To: <20060914142249.GK23891@pasky.or.cz>

On Thu, 14 Sep 2006, Petr Baudis wrote:

> 
>   just to test the packing improvements we had achieved over the last
> year, I have repacked the historical kernel repository and achieved a
> significant improvement:

Umm.. Only apparently because the old pack was really really bad. It also has the wrong name, probably because it's using the original naming that had the SHA1 computed on the unsorted input. That was changed a long time ago.

Yours isn't wonderful either.

> -rw-r--r-- 1 xpasky users  13600376 Sep 14 16:18 pack-4d27038611fe7755938efd4a2745d5d5d35de1c1.idx
> -rw-r--r-- 1 xpasky users 197168186 Sep 14 16:18 pack-4d27038611fe7755938efd4a2745d5d5d35de1c1.pack
> -rw-r--r-- 1 xpasky users  13600376 Sep 14 12:18 pack-cc3517351ecce3ef7ba010559992bdfc10b7acd4.idx
> -rw-r--r-- 1 xpasky users 262818936 Sep 14 12:29 pack-cc3517351ecce3ef7ba010559992bdfc10b7acd4.pack

Mine are:

-rw-r--r-- 1 torvalds torvalds 13600376 Apr 19 10:06 pack-4d27038611fe7755938efd4a2745d5d5d35de1c1.idx -rw-r--r-- 1 torvalds torvalds 185374386 Apr 19 10:06 pack-4d27038611fe7755938efd4a2745d5d5d35de1c1.pack

and as you can see from the date, they aren't exactly very recent, but they shave an additional 6% off the size.

I agree that the _oroginal_ history pack by Thomas seems to be bad, and that's from Aug 9 2005, so it's likely with some really really old packing rules.

For better packing, I think I used a larger depth, ie try something like

	git repack -a -f --depth=50

to get more improvement. For a historical archive that you don't much use, doign the deeper depth is definitely worth it.

		Linus