Re: Question about git gc on large text files

From: Jeff King <peff@peff.net>
Date: Aug 17, 2017, 17:33 UTC
Message-ID: <20170817173314.qjzii4e4rybqqn34@sigill.intra.peff.net>
In-Reply-To: <60A624DB-CFD1-4A62-A58B-80176F96BA30@netskope.com>

On Thu, Aug 17, 2017 at 10:28:00AM -0700, Kai Zhang wrote:

Show 10 quoted lines

> I have a git repository maintaining one large json file (along with
> several other small files). With commits for large json file, the
> repository become bigger and bigger, so I tried to run command "git gc
> --prune=now --aggressive" to reduce disk usage, then I found .git
> folder size did not change. I had wonderful experience with git gc
> against files around 10M to 20M, and I am wondering if there is any
> configuration need to tweak for large text files?
> 
> Here I have more details:
> 1. Json file size: 1G

Git won't try to delta-compress anything over 500MB by default. Try:

  git config core.bigfilethreshold 2G
  git gc --aggressive

-Peff