Re: [PATCH 1/2] archive-tar: write extended headers for file sizes >= 8GB
- From
Robin H. Johnson <robbat2@gentoo.org>
- Date
- Jun 21, 2016, 19:44 UTC
- Message-ID
- <robbat2-20160621T185126-722667990Z@orbis-terrarum.net>
- In-Reply-To
- <20160616043733.GA18323@sigill.intra.peff.net>
On Thu, Jun 16, 2016 at 12:37:33AM -0400, Jeff King wrote:
> We could ship just the resulting compressed object data as a > loose object, but even that takes 64MB. So sadly, this code > path remains untested in the test suite.
Additionally compress the object data, and insert it for the purpose of testing? It's still an expensive test time-wise, but repeated gzip compression on zeros does still help; to that end, here's the pieces to add a testcase while only being <9KiB.
t5005-archive-hugefile.sh: ... mkdir t zcat t5005-barerepo-64gb-obj.tar.gz.gz | tar xzf - -C t GIT_DIR=t git archive HEAD | head -c 10000 | tar tvf - 2>/dev/null ...
Test repo attached, it's only 8KiB.
Test repo can be recreated with: truncate -s 64g bigfile git add bigfile # takes 10 mins git commit -q -m foo # takes another 10 minutes tar cf - -C .git . |gzip -9 --no-name |gzip -9f --no-name >barerepo.tar.gz.gz
-- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Trustee & Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136