threads / discuss / 21965

git svn clone just stops

Subject: git svn clone just stops

## tl;dr

6 messages between Dec 15, 2009 and Dec 20, 2009.

replies: 5people: 3as markdown or json

Mark Jerkovic· Dec 15, 2009, 22:19 UTC · lore

Hi all,

I am new to Git and I am attempting to clone a SVN repository (containing approximately 60,000 commits) to Git.

Using Git v1.6.0.4 with the following command:

git svn clone https://path/to/svn/repo/trunk project.git --authors-file=svnauthors.txt --no-metadata

the process just ends without any messages and the Git repository is empty. I have attempted this four times already, and each time it has stopped after a different revision, so I can't pin it down to a particular commit.

Has anyone experienced this before? Is there a log anywhere that records what is happening during this process?

Thanks, Mark.

Eric Wong· Dec 16, 2009, 08:15 UTC · re: Mark Jerkovic · lore

Re: git svn clone just stops

Mark Jerkovic <mjerkovic@aconex.com> wrote:

Show 14 quoted lines

> Hi all,
> 
> I am new to Git and I am attempting to clone a SVN repository
> (containing approximately 60,000 commits) to Git.
> 
> Using Git v1.6.0.4 with the following command:
> 
> git svn clone https://path/to/svn/repo/trunk project.git
> --authors-file=svnauthors.txt --no-metadata
> 
> the process just ends without any messages and the Git repository is
> empty.  I have attempted this four times already, and each time it has
> stopped after a different revision, so I can't pin it down to a
> particular commit.

Hi Mark,

Any chance you're OOM-ing (extremely large file) or running out of space somewhere? What exit code do you get when it exits?

> Has anyone experienced this before?  Is there a log anywhere that
> records what is happening during this process?

Not without error messages of some sort. git svn was designed with poor network conditions in mind and clone is resumable, so you can just resume like this:

   cd project.git && git svn fetch

I wouldn't use --no-metadata at this point, though, as it makes it much harder to debug/fix things or recover from errors.

Once you're comfortable with it, you should be able to write "git filter-branch" invocation to remove the metadata lines.

-- 
Eric Wong

Mark Jerkovic· Dec 16, 2009, 20:47 UTC · re: Eric Wong · lore

Re: git svn clone just stops

On Wed, 2009-12-16 at 00:15 -0800, Eric Wong wrote:

Show 30 quoted lines

> Mark Jerkovic <mjerkovic@aconex.com> wrote:
> > Hi all,
> > 
> > I am new to Git and I am attempting to clone a SVN repository
> > (containing approximately 60,000 commits) to Git.
> > 
> > Using Git v1.6.0.4 with the following command:
> > 
> > git svn clone https://path/to/svn/repo/trunk project.git
> > --authors-file=svnauthors.txt --no-metadata
> > 
> > the process just ends without any messages and the Git repository is
> > empty.  I have attempted this four times already, and each time it has
> > stopped after a different revision, so I can't pin it down to a
> > particular commit.
> 
> Hi Mark,
> 
> Any chance you're OOM-ing (extremely large file) or running
> out of space somewhere?  What exit code do you get when it exits?
> 
> > Has anyone experienced this before?  Is there a log anywhere that
> > records what is happening during this process?
> 
> Not without error messages of some sort.  git svn was designed with poor
> network conditions in mind and clone is resumable, so you can just
> resume like this:
> 
>    cd project.git && git svn fetch
>

That is an excellent tip.  Thanks a lot!

Show 5 quoted lines

> I wouldn't use --no-metadata at this point, though, as it makes it much
> harder to debug/fix things or recover from errors.
> 
> Once you're comfortable with it, you should be able to write
> "git filter-branch" invocation to remove the metadata lines.

I have done some more investigating and it appears that at some point a branch was moved to replace our trunk. When the migration process hits this I it goes back to the beginning and starts migrating the branch history too. I think when it gets to the end of it is not able to resume from the "move" point.

I will try your resume tip to see if I can get it started again.

Many thanks, Mark.

Pascal Obry· Dec 18, 2009, 15:00 UTC · re: Eric Wong · lore

Re: git svn clone just stops

Eric,

Show 5 quoted lines

> Not without error messages of some sort.  git svn was designed with poor
> network conditions in mind and clone is resumable, so you can just
> resume like this:
> 
>    cd project.git && git svn fetch

What about --revision option. I mean if I have this clone interrupted:

   $ git svn clone --revision=345:HEAD svn+ssh://...

Should I specify --revision when restarting with fetch? I think I had an issue with this...

Maybe some other options are also to be passed to fetch?

Thanks.

-- 
--|------------------------------------------------------
--| Pascal Obry                           Team-Ada Member
--| 45, rue Gabriel Peri - 78114 Magny Les Hameaux FRANCE
--|------------------------------------------------------
--|    http://www.obry.net  -  http://v2p.fr.eu.org
--| "The best way to travel is by means of imagination"
--|
--| gpg --keyserver keys.gnupg.net --recv-key F949BD3B

Eric Wong· Dec 20, 2009, 08:57 UTC · re: Pascal Obry · lore

Re: git svn clone just stops

Pascal Obry <pascal@obry.net> wrote:

Show 16 quoted lines

> Eric,
> 
> > Not without error messages of some sort.  git svn was designed with poor
> > network conditions in mind and clone is resumable, so you can just
> > resume like this:
> > 
> >    cd project.git && git svn fetch
> 
> What about --revision option. I mean if I have this clone interrupted:
> 
>    $ git svn clone --revision=345:HEAD svn+ssh://...
> 
> Should I specify --revision when restarting with fetch? I think I had an
> issue with this...
> 
> Maybe some other options are also to be passed to fetch?

Hi Pascal,

--revision may be passed to fetch, but its optional. fetch should always know where to pickup after it left off.

"git svn $command -h" shows you all options a particular $command allows.

-- 
Eric Wong

Pascal Obry· Dec 20, 2009, 09:44 UTC · re: Eric Wong · lore

Re: git svn clone just stops

Hi Eric,

> --revision may be passed to fetch, but its optional.  fetch should
> always know where to pickup after it left off.

Ok, thanks for the info.

-- 
--|------------------------------------------------------
--| Pascal Obry                           Team-Ada Member
--| 45, rue Gabriel Peri - 78114 Magny Les Hameaux FRANCE
--|------------------------------------------------------
--|    http://www.obry.net  -  http://v2p.fr.eu.org
--| "The best way to travel is by means of imagination"
--|
--| gpg --keyserver keys.gnupg.net --recv-key F949BD3B