From: Shawn O. Pearce Date: Thu, 04 Jan 2007 02:35:11 GMT Subject: Re: git-svnimport failed and now git-repack hates me Message-ID: <20070104023510.GC18206@spearce.org> In-Reply-To: <20070104020652.GB18206@spearce.org> "Shawn O. Pearce" wrote: > Linus Torvalds wrote: > > Junio - I suspect "pack-check.c" really shouldn't try to do it as one > > single humungous "SHA1_Update()" call. It showed one bug on PPC, I > > wouldn't be surprised if it's implicated now on some other architecture. > > It used to do it as one big SHA1_Update() call... > > > Shawn - does the pack-file-windowing thing already change that? I'm too > > lazy to check.. > > But with the mmap window thing in `next` it does it in window > units only. Which the user could configure to be huge, or could > configure to be sane. The default when using mmap() is 32 MiB; > 1 MiB when using pread() and git_mmap(). I should also point out that my git-fastimport hack that we used on the huge Mozilla import may be helpful here. Its _very_ fast as it goes right to a pack file, but there's no SVN frontend for it at this time. -- Shawn.