git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: fast-import slowness when importing large files with small differences

From
Stefan Beller <sbeller@google.com>
Date
Jun 29, 2018, 20:51 UTC
Message-ID
<CAGZ79kYSFnKhMPi3J=C-XHMuAg90J76Vir6ocv0uKWoKts4P-w@mail.gmail.com>
In-Reply-To
<20180629203904.GA27566@sigill.intra.peff.net>
+cc Jun Wu, original author of these patches
On Fri, Jun 29, 2018 at 1:39 PM Jeff King <peff@peff.net> wrote:
> > Interesting pieces regarding performance:
> >
> > c420792217c8 xdiff: reduce indent heuristic overhead
> > https://phab.mercurial-scm.org/rHGc420792217c89622482005c99e959b9071c109c5

Going by the mailing list, the first patch was not brought over yet, so sending it here was warranted.

Jun, you may want to take ownership of https://public-inbox.org/git/20180629202811.131265-1-sbeller@google.com/ as I merely resend it to the git mailing list? If not, that is fine, too.

Show 8 quoted lines
> >
> > f33a87cf60cc xdiff: add a preprocessing step that trims files
> > https://phab.mercurial-scm.org/rHGf33a87cf60ccb8b46e06b85e60bc5031420707d6
> >
> > I'll see if I can make that into patches.
>
> Apparently the second one is not so trivial as you might hope; see
> https://public-inbox.org/git/1520337165-sup-4504@x1c/.

Thanks so much, this saves me further effort to dig there. So I'll just stop porting this.

Thanks, Stefan

Previous: Jeff KingNext: Ævar Arnfjörð Bjarmason
Message 13 of 17 in “fast-import slowness when importing large files with small differences”
  1. Mike HommeyJun 29, 2018
  2. Stefan BellerJun 29, 2018
  3. xdiff: reduce indent heuristic overheadStefan Beller, Jun 29, 2018
  4. Junio C HamanoJun 29, 2018
  5. xdiff: reduce indent heuristic overheadStefan Beller, Jun 29, 2018
  6. Jun WuJun 30, 2018
  7. Michael HaggertyJul 1, 2018
  8. Stefan BellerJul 2, 2018
  9. Michael HaggertyJul 3, 2018
  10. xdiff: reduce indent heuristic overheadStefan Beller, Jul 27, 2018
  11. Junio C HamanoJul 3, 2018
  12. Jeff KingJun 29, 2018
  13. Stefan BellerJun 29, 2018
  14. Ævar Arnfjörð BjarmasonJun 29, 2018
  15. Mike HommeyJun 29, 2018
  16. Ævar Arnfjörð BjarmasonJul 3, 2018
  17. Mike HommeyJul 3, 2018

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.