git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Excruciatingly slow git-svn imports

From
EWEric Wong <normalperson@yhbt.net>
Date
Apr 29, 2008, 07:03 UTC
Message-ID
<20080429070355.GF24171@muzzle>
In-Reply-To
<CC0F600D-71F3-493A-AA9C-AF901C1A58C4@adacore.com>
Geert Bosch <bosch@adacore.com> wrote:
> Before trying to brush up my Perl and propose patching fixes for this
> (I doubt the extra execve's take much time at all), I was wondering why
> we don't open a single stream to git-fast-import and have it do
> the heavy lifting. Are there fundamental issues with this?

Last I checked, fast-import doesn't allow rereading freshly imported objects before that particular fast-import instance is finished running.

Since git-svn imports deltas from SVN instead of full files, so it often needs to reread objects it imported in the same run to make use of deltas.

However, Adam Roben's been working on some improvements to git-cat-file which allow it to avoid many fork+exec calls. The tests and some code have some outstanding issues, but the code appears to work, and I'm sure Adam would love to have you test it more for him :)

 http://thread.gmane.org/gmane.comp.version-control.git/80240
-- 
Eric Wong
Previous: Geert Bosch
Message 9 of 9 in “Excruciatingly slow git-svn imports”
  1. Geert BoschApr 24, 2008
  2. Steven GrimmApr 24, 2008
  3. Eric WongApr 29, 2008
  4. Geert BoschMay 5, 2008
  5. Eric WongMay 6, 2008
  6. Avery PennarunMay 6, 2008
  7. Eric WongMay 6, 2008
  8. Geert BoschMay 6, 2008
  9. Eric WongApr 29, 2008

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.