Re: git-svn performance

From: Fabian Schmied <fabian.schmied@gmail.com>
Date: Oct 19, 2014, 09:38 UTC
Message-ID: <CABBCAivMYZJ-b2CFuCxBPRBYRkhJ_sKMBRHkenfqjpJbYcx5vw@mail.gmail.com>
In-Reply-To: <20141019003256.GA18532@dcvr.yhbt.net>

On Sun, Oct 19, 2014 at 2:32 AM, Eric Wong <normalperson@yhbt.net> wrote:

Show 11 quoted lines

> Fabian Schmied <fabian.schmied@gmail.com> wrote:
>> Hi,
>>
>> I'm currently migrating an SVN repository to Git using git-svn (Git
>> for Windows 1.8.3-preview20130601), and I'm experiencing severe
>> performance problems with "git svn fetch". Commits to the SVN "trunk"
>> are fetched very fast (a few seconds or so per SVN revision), but
>> commits to some branches ("hotfix" branches) are currently taking
>> about 9 minutes per revision. I fear that the time per these commits
>> is increasing and that indeed the migration might not be finishable at
>> all.

[...]

Show 14 quoted lines

>> Is there anything I can do to speed this up? (I already tried
>> increasing the --log-window-size to 500, didn't have any effect.)
>
> Can you take a look at the following two "mergeinfo-speedups"
> in my repo?  (git://bogomips.org/git-svn)
>
> Jakob Stoklund Olesen (2):
>       git-svn: only look at the new parts of svn:mergeinfo
>       git-svn: only look at the root path for svn:mergeinfo
>
> Also downloadable here:
>
> http://bogomips.org/git-svn.git/patch?id=9b258e721b30785357535
> http://bogomips.org/git-svn.git/patch?id=73409a2145e93b436d74a

[...]

Thank you _very_ much, the performance increase is tremendous: from, ATM, 15 minutes per commit (with large merge-infos) down to 15 seconds each. This means that instead of taking weeks, the migration will now complete in hours! Memory consumption might be a bit higher, but not a problem for me at all.

(I didn't apply the two additional patches you supplied, only the two ones linked above.)

Thanks again, you saved my deadline :) Fabian