git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: svn to git, N-squared?

From
Jon Smirl <jonsmirl@gmail.com>
Date
Jun 12, 2006, 03:39 UTC
Message-ID
<9e4733910606112039p7aff60c7w7a074d0e35c7b0f@mail.gmail.com>
In-Reply-To
<Pine.LNX.4.64.0606112028010.5498@g5.osdl.org>
On 6/11/06, Linus Torvalds <torvalds@osdl.org> wrote:
Show 22 quoted lines
>
>
> On Sun, 11 Jun 2006, Jon Smirl wrote:
> >
> > I have Mozilla CVS in a SVN repository. I've been using git-svnimport
> > to import it. This time I am letting it run to completion; but the
> > import has been running for four days now and it is only up to 2004.
> > The import task is stable at 570MB and it is using about 50% of my
> > CPU. It is constantly spawning off git write-tree, read-tree,
> > hash-object, update-index. It is not doing excessive disk activity.
>
> This sounds like _exactly_ what happens if you don't repack occasionally.
> Expecially if you are using a filesystem without hashed filename lookup,
> but it's true to some degree even with that - the filesystem tends to end
> up spending tons of time in kernel space, trying to find a place to put
> new objects.
>
> I don't think git-svnimport has the repack logic in it, so that would be
> it.
>
> You can probably stop it with ^Z, do a "git repack -a -d", and then let it
> continue.

I have it stopped and I am running the repack. There are 1.27M files in my .git directory

I ordered 2GB more RAM which should be here Tuesday.
Show 8 quoted lines
> (The only reason for stopping it is actually to let "git repack" remove
> most of the object directories - many filesystems, including ext3, don't
> even speed up all that much if the directories are emptied after they've
> grown big, and it's much better if the object directories get totally
> removed and re-created)
>
>                         Linus
>
-- 
Jon Smirl
jonsmirl@gmail.com
Previous: Linus TorvaldsNext: Linus Torvalds
Message 3 of 9 in “svn to git, N-squared?”
  1. Jon SmirlJun 12, 2006
  2. Linus TorvaldsJun 12, 2006
  3. Jon SmirlJun 12, 2006
  4. Linus TorvaldsJun 12, 2006
  5. Yakov LernerJun 12, 2006
  6. Linus TorvaldsJun 12, 2006
  7. Randal L. SchwartzJun 12, 2006
  8. Randal L. SchwartzJun 12, 2006
  9. Eric WongJun 12, 2006

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.