Re: svn to git, N-squared?
- From
Jon Smirl <jonsmirl@gmail.com>
- Date
- Jun 12, 2006, 16:32 UTC
- Message-ID
- <9e4733910606120932k5b6f7acfra3f3a26168454f47@mail.gmail.com>
- In-Reply-To
- <9e4733910606120922g181a5aaal623fd3f29b839f4c@mail.gmail.com>
On 6/12/06, Jon Smirl <jonsmirl@gmail.com> wrote:
Show 24 quoted lines
> On 6/12/06, Linus Torvalds <torvalds@osdl.org> wrote: > > > > > > On Mon, 12 Jun 2006, Jon Smirl wrote: > > > > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > > 14525 jonsmirl 16 0 604m 391m 1904 S 24 38.7 916:53.39 git-svnimport > > > 20947 jonsmirl 17 0 0 0 0 R 1 0.0 0:00.03 git-svnimport > > > > Hard to tell, it's obviously got short-lived processes there too that it's > > not showing, but equally obviously that svnimport script itself is > > spending an alarming amount of CPU time. I don't think it should do that > > much processing, but since it's written in perl, I can't read it. > > > > Are there any other directories that seem to be growing (eg some temp-file > > directory where the old files aren't cleaned away?). I can't imagine what > > else it could be doing in kernel space than simply some silly filesystem > > operation, but dang it all, Linux filesystems are usually very efficient > > indeed, unless we're talking huge directories (and if it's not the git > > object directory any more, it must be something else). > > 64 files in tmp. > But the SVN repository itself has 411,000 files in it. Split between > two directories.
I'm doing all of this on ext3. I have plenty of free disk space so I can make another partition and switch to a new file system after I install the new RAM. What would be the best one to try? Doing that would provide a data point to determine if this is a problem with file system performance or the misuse of file systems.
-- Jon Smirl jonsmirl@gmail.com