git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: git-fast-import yields huge packfile

From
Mike Hommey <mh@glandium.org>
Date
Mar 16, 2019, 22:12 UTC
Message-ID
<20190316221232.m6mphdnwy6mys4j2@glandium.org>
In-Reply-To
<CAADWXX81agAg1B9+FM5c4JsWzANKochNTcv2ShsRzAsZpHAVWw@mail.gmail.com>
On Sat, Mar 16, 2019 at 02:04:33PM -0700, Linus Torvalds wrote:
Show 7 quoted lines
> On Sat, Mar 16, 2019 at 1:31 PM Richard Hipp <drh@sqlite.org> wrote:
> >
> > Maybe I'm doing something wrong with the fast-import stream that is
> > defeating Git's attempts at delta compression....
> 
> fast-import doesn't do fancy delta compression becayse that would
> defeat the "fast" part of fast-import.

fast-import however does try to do delta compression of blobs against the last blob that was imported, so if you put your blobs in an order where they can be delta-ed, you can win without a git repack.

For one-shot conversions, you can just rely on git repack.
Mike
Previous: Linus TorvaldsNext: Richard Hipp
Message 3 of 6 in “git-fast-import yields huge packfile”
  1. Richard HippMar 16, 2019
  2. Linus TorvaldsMar 16, 2019
  3. Mike HommeyMar 16, 2019
  4. Richard HippMar 16, 2019
  5. Johannes SchindelinMar 21, 2019
  6. Ævar Arnfjörð BjarmasonMar 21, 2019

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.