git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: svn to git, N-squared?

From
Jon Smirl <jonsmirl@gmail.com>
Date
Jun 12, 2006, 16:32 UTC
Message-ID
<9e4733910606120932k5b6f7acfra3f3a26168454f47@mail.gmail.com>
In-Reply-To
<9e4733910606120922g181a5aaal623fd3f29b839f4c@mail.gmail.com>
On 6/12/06, Jon Smirl <jonsmirl@gmail.com> wrote:
Show 24 quoted lines
> On 6/12/06, Linus Torvalds <torvalds@osdl.org> wrote:
> >
> >
> > On Mon, 12 Jun 2006, Jon Smirl wrote:
> > >
> > >  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> > > 14525 jonsmirl  16   0  604m 391m 1904 S   24 38.7 916:53.39 git-svnimport
> > > 20947 jonsmirl  17   0     0    0    0 R    1  0.0   0:00.03 git-svnimport
> >
> > Hard to tell, it's obviously got short-lived processes there too that it's
> > not showing, but equally obviously that svnimport script itself is
> > spending an alarming amount of CPU time. I don't think it should do that
> > much processing, but since it's written in perl, I can't read it.
> >
> > Are there any other directories that seem to be growing (eg some temp-file
> > directory where the old files aren't cleaned away?). I can't imagine what
> > else it could be doing in kernel space than simply some silly filesystem
> > operation, but dang it all, Linux filesystems are usually very efficient
> > indeed, unless we're talking huge directories (and if it's not the git
> > object directory any more, it must be something else).
>
> 64 files in tmp.
> But the SVN repository itself has 411,000 files in it. Split between
> two directories.

I'm doing all of this on ext3. I have plenty of free disk space so I can make another partition and switch to a new file system after I install the new RAM. What would be the best one to try? Doing that would provide a data point to determine if this is a problem with file system performance or the misuse of file systems.

-- 
Jon Smirl
jonsmirl@gmail.com
Previous: Jon SmirlNext: Linus Torvalds
Message 7 of 14 in “Re: svn to git, N-squared?”
  1. linux@horizon.comJun 12, 2006
  2. Jon SmirlJun 12, 2006
  3. Linus TorvaldsJun 12, 2006
  4. Jon SmirlJun 12, 2006
  5. Linus TorvaldsJun 12, 2006
  6. Jon SmirlJun 12, 2006
  7. Jon SmirlJun 12, 2006
  8. Linus TorvaldsJun 12, 2006
  9. Linus TorvaldsJun 12, 2006
  10. Jon SmirlJun 12, 2006
  11. Linus TorvaldsJun 12, 2006
  12. Jon SmirlJun 12, 2006
  13. Jon SmirlJun 12, 2006
  14. Jon SmirlJun 12, 2006

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.