{"thread":{"id":"14392","subject":"Errors importing Apache Synapse SVN using Git","startedAt":"2008-07-10T12:01:39Z","lastAt":"2008-07-14T09:14:33Z","messageCount":6,"participants":["Asankha C. Perera","Michael J Gruber","Björn Steinbrink","Eric Wong"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"82808","messageId":"4875FA23.30603@wso2.com","threadId":"14392","inReplyTo":"4875F5D6.9080906@wso2.com","subject":"Errors importing Apache Synapse SVN using Git","fromName":"Asankha C. Perera","fromEmail":"asankha@wso2.com","sentAt":"2008-07-10T12:01:39Z","receivedAt":"2008-07-10T12:01:39Z","isPatch":false,"sender":{"key":"asankha@wso2.com","avatar":null},"body":"Hi All\n\nI am an Apache Synapse developer, and want to import the Synapse SVN \nrepo into Git, so that Ohloh can properly get the Synapse history \n(http://www.ohloh.net/topics/1326?page=1#post_6287)\n\nHowever, when I try the command: \"git svn clone --trunk=trunk \n--tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse\" \nit seems to take forever, (or at least until the next network glitch), \nand keeps filling up a file with just plain zeros (\"0\") : \n./.git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68\n\nCan someone try the above command on the Synapse repo and tell me what I \ncan do to import from the SVN?\n\nmany thanks\nasankha\n"},{"id":"82809","messageId":"g55130$n3i$1@ger.gmane.org","threadId":"14392","inReplyTo":"4875FA23.30603@wso2.com","subject":"Re: Errors importing Apache Synapse SVN using Git","fromName":"Michael J Gruber","fromEmail":"michaeljgruber+gmane@fastmail.fm","sentAt":"2008-07-10T12:59:11Z","receivedAt":"2008-07-10T12:59:11Z","isPatch":false,"sender":{"key":"git@grubix.eu","avatar":"https://avatars.githubusercontent.com/u/233215?v=4"},"body":"Asankha C. Perera venit, vidit, dixit 10.07.2008 14:01:\n> Hi All\n> \n> I am an Apache Synapse developer, and want to import the Synapse SVN \n> repo into Git, so that Ohloh can properly get the Synapse history \n> (http://www.ohloh.net/topics/1326?page=1#post_6287)\n> \n> However, when I try the command: \"git svn clone --trunk=trunk \n> --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse\" \n> it seems to take forever, (or at least until the next network glitch), \n> and keeps filling up a file with just plain zeros (\"0\") : \n> ./.git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68\n> \n> Can someone try the above command on the Synapse repo and tell me what I \n> can do to import from the SVN?\n\n\"svn log\" takes forever on that repo, too. Current rev seems to be \n675546, and the synapse path does not exist in early revisions. Knowing \nthe initial revision would help, then you could save \"git svn\" from \nhaving to comb through (supposedly) tens of thousands of irrelevant revs.\n\nI just checked out trunk using svn 1.4.6, \"svn log .\" takes forever in \nthe root dir. So the svn repo seems to be largely unusable, at least \nwhen accessed from svn 1.4.6 clients (the server is 1.5.0, I see).\n\nOkay, I bisected it and got r234477 as the beginning of time for \nsynapse. \"svn log -r 234477:HEAD\" is still painful.\n\nYou may want to fetch 1000 revs each or so from there each time.\n\nMichael\n"},{"id":"82853","messageId":"20080710220253.GD2325@atjola.homenet","threadId":"14392","inReplyTo":"g55130$n3i$1@ger.gmane.org","subject":"Re: Errors importing Apache Synapse SVN using Git","fromName":"Björn Steinbrink","fromEmail":"b.steinbrink@gmx.de","sentAt":"2008-07-10T22:02:53Z","receivedAt":"2008-07-10T22:02:53Z","isPatch":false,"sender":{"key":"b.steinbrink@gmx.de","avatar":"https://avatars.githubusercontent.com/u/230962?v=4"},"body":"On 2008.07.10 14:59:11 +0200, Michael J Gruber wrote:\n> Asankha C. Perera venit, vidit, dixit 10.07.2008 14:01:\n>> Hi All\n>>\n>> I am an Apache Synapse developer, and want to import the Synapse SVN  \n>> repo into Git, so that Ohloh can properly get the Synapse history  \n>> (http://www.ohloh.net/topics/1326?page=1#post_6287)\n>>\n>> However, when I try the command: \"git svn clone --trunk=trunk  \n>> --tags=tags --branches=branches \n>> http://svn.apache.org/repos/asf/synapse\" it seems to take forever, (or \n>> at least until the next network glitch), and keeps filling up a file \n>> with just plain zeros (\"0\") :  \n>> ./.git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68\n>>\n>> Can someone try the above command on the Synapse repo and tell me what \n>> I can do to import from the SVN?\n>\n> \"svn log\" takes forever on that repo, too. Current rev seems to be  \n> 675546, and the synapse path does not exist in early revisions. Knowing  \n> the initial revision would help, then you could save \"git svn\" from  \n> having to comb through (supposedly) tens of thousands of irrelevant revs.\n>\n> I just checked out trunk using svn 1.4.6, \"svn log .\" takes forever in  \n> the root dir. So the svn repo seems to be largely unusable, at least  \n> when accessed from svn 1.4.6 clients (the server is 1.5.0, I see).\n>\n> Okay, I bisected it and got r234477 as the beginning of time for  \n> synapse. \"svn log -r 234477:HEAD\" is still painful.\n>\n> You may want to fetch 1000 revs each or so from there each time.\n\nAlso, upgrading git to 1.5.6.2 might be a good idea. It doesn't use the\n.revdb file format anymore, but a more efficient .revmap file. And it\nhas quite a few performance improvements (although they won't help\nagainst the primary issue with that svn server). Don't use\n1.5.6/1.5.6.1, they have a git-svn bug that can lead to corrupted clones\n(just in case that your distro has packages for those versions but not\nyet got 1.5.6.2).\n\nBjörn\n"},{"id":"82946","messageId":"48774A0F.2070805@fastmail.fm","threadId":"14392","inReplyTo":"4875FA23.30603@wso2.com","subject":"Re: Errors importing Apache Synapse SVN using Git","fromName":"Michael J Gruber","fromEmail":"michaeljgruber+gmane@fastmail.fm","sentAt":"2008-07-11T11:54:55Z","receivedAt":"2008-07-11T11:54:55Z","isPatch":false,"sender":{"key":"git@grubix.eu","avatar":"https://avatars.githubusercontent.com/u/233215?v=4"},"body":"Asankha C. Perera venit, vidit, dixit 10.07.2008 14:01:\n> Hi All\n> \n> I am an Apache Synapse developer, and want to import the Synapse SVN \n> repo into Git, so that Ohloh can properly get the Synapse history \n> (http://www.ohloh.net/topics/1326?page=1#post_6287)\n> \n> However, when I try the command: \"git svn clone --trunk=trunk \n> --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse\" \n> it seems to take forever, (or at least until the next network glitch), \n> and keeps filling up a file with just plain zeros (\"0\") : \n> ./.git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68\n\nOkay, besides the zero offset, there seems to be big problem with the \nsvn repo:\n\nsvn list -r 234478 http://svn.apache.org/repos/asf/synapse\nbranches/\nsite/\ntags/\ntrunk/\n\nsvn list -r 234478 http://svn.apache.org/repos/asf|grep synapse\n\nRight, nothing returned.\n\ngit-svn insists on using http://svn.apache.org/repos/asf as the base \nURL, which is basically correct, but doesn't work for this repo.\n\nEven editing .git/config and .git/svn/metadata (after git svn init, \nbefire the first fetch) to change the url doesn't help. git svn still \nuses .../asf. Is this as intended? cc'ing the git svn author.\n\nMichael\n"},{"id":"83235","messageId":"20080714081615.GB10304@hand.yhbt.net","threadId":"14392","inReplyTo":"48774A0F.2070805@fastmail.fm","subject":"Re: Errors importing Apache Synapse SVN using Git","fromName":"Eric Wong","fromEmail":"normalperson@yhbt.net","sentAt":"2008-07-14T08:16:15Z","receivedAt":"2008-07-14T08:16:15Z","isPatch":false,"sender":{"key":"e@80x24.org","avatar":null},"body":"Michael J Gruber <michaeljgruber+gmane@fastmail.fm> wrote:\n> Asankha C. Perera venit, vidit, dixit 10.07.2008 14:01:\n> >Hi All\n> >\n> >I am an Apache Synapse developer, and want to import the Synapse SVN \n> >repo into Git, so that Ohloh can properly get the Synapse history \n> >(http://www.ohloh.net/topics/1326?page=1#post_6287)\n> >\n> >However, when I try the command: \"git svn clone --trunk=trunk \n> >--tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse\" \n> >it seems to take forever, (or at least until the next network glitch), \n> >and keeps filling up a file with just plain zeros (\"0\") : \n> >./.git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68\n\nThe latest versions of git-svn should be vastly more space efficient\nwith .rev_map files.\n \n> Okay, besides the zero offset, there seems to be big problem with the \n> svn repo:\n> \n> svn list -r 234478 http://svn.apache.org/repos/asf/synapse\n> branches/\n> site/\n> tags/\n> trunk/\n> \n> svn list -r 234478 http://svn.apache.org/repos/asf|grep synapse\n\nAh, that's because it started off in the /incubator directory, not /synapse:\n\n$ svn log -v -r 234478 http://svn.apache.org/repos/asf\n------------------------------------------------------------------------\nr234478 | dims | 2005-08-22 05:39:51 -0700 (Mon, 22 Aug 2005) | 3 lines\nChanged paths:\n   A /incubator/synapse/branches\n   A /incubator/synapse/site\n   A /incubator/synapse/tags\n   A /incubator/synapse/trunk\n\ninit synapse SVN\n\n\n------------------------------------------------------------------------\n\n> Right, nothing returned.\n> \n> git-svn insists on using http://svn.apache.org/repos/asf as the base \n> URL, which is basically correct, but doesn't work for this repo.\n> \n> Even editing .git/config and .git/svn/metadata (after git svn init, \n> befire the first fetch) to change the url doesn't help. git svn still \n> uses .../asf. Is this as intended? cc'ing the git svn author.\n\nCan you try using the latest git-svn and also --no-follow-parent?\n\n--no-follow-parent won't traverse copy history so it may be faster,\nbut you'll get an incomplete history.\n\nOn the other hand, it looks like the asf repo is hopelessly slow\nfor history retrieval.\n\nI'm pulling the asf log (svn log -v http://svn.apache.org/repos/asf >\ntmp.log) but it's taking forever...  git-svn uses basically the same\noperation as 'svn log -v' and I've yet to see an SVN server take this\nlong to show history.\n\nI've gotten 70,000 revisions after over one hour with the above svn log\ncommand.  I'm going to restart this from a server with a better\nconnection since I need to power off this one when I sleep.\n\n-- \nEric Wong\n"},{"id":"83243","messageId":"487B18F9.5090908@fastmail.fm","threadId":"14392","inReplyTo":"20080714081615.GB10304@hand.yhbt.net","subject":"Re: Errors importing Apache Synapse SVN using Git","fromName":"Michael J Gruber","fromEmail":"michaeljgruber+gmane@fastmail.fm","sentAt":"2008-07-14T09:14:33Z","receivedAt":"2008-07-14T09:14:33Z","isPatch":false,"sender":{"key":"git@grubix.eu","avatar":"https://avatars.githubusercontent.com/u/233215?v=4"},"body":"Eric Wong venit, vidit, dixit 14.07.2008 10:16:\n> Michael J Gruber <michaeljgruber+gmane@fastmail.fm> wrote:\n>> Asankha C. Perera venit, vidit, dixit 10.07.2008 14:01:\n>>> Hi All\n>>>\n>>> I am an Apache Synapse developer, and want to import the Synapse SVN \n>>> repo into Git, so that Ohloh can properly get the Synapse history \n>>> (http://www.ohloh.net/topics/1326?page=1#post_6287)\n>>>\n>>> However, when I try the command: \"git svn clone --trunk=trunk \n>>> --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse\" \n>>> it seems to take forever, (or at least until the next network glitch), \n>>> and keeps filling up a file with just plain zeros (\"0\") : \n>>> ./.git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68\n> \n> The latest versions of git-svn should be vastly more space efficient\n> with .rev_map files.\n>  \n>> Okay, besides the zero offset, there seems to be big problem with the \n>> svn repo:\n>>\n>> svn list -r 234478 http://svn.apache.org/repos/asf/synapse\n>> branches/\n>> site/\n>> tags/\n>> trunk/\n>>\n>> svn list -r 234478 http://svn.apache.org/repos/asf|grep synapse\n> \n> Ah, that's because it started off in the /incubator directory, not /synapse:\n> \n> $ svn log -v -r 234478 http://svn.apache.org/repos/asf\n> ------------------------------------------------------------------------\n> r234478 | dims | 2005-08-22 05:39:51 -0700 (Mon, 22 Aug 2005) | 3 lines\n> Changed paths:\n>    A /incubator/synapse/branches\n>    A /incubator/synapse/site\n>    A /incubator/synapse/tags\n>    A /incubator/synapse/trunk\n> \n> init synapse SVN\n\nYes, and later on there was some more moving around to \n\"webservices/synapse/synapse\", \".../syaps2\", \".../synapse\" (i.e. \nrenaming \"synapse/synapse\" to \"synapse\") and then to the final destination.\n\nSome svn client command know how to follow moves, other don't. I can't \nmake them return results by using peg revisions, but I don't know how \ngit-svn handles them.\n\n\n> ------------------------------------------------------------------------\n> \n>> Right, nothing returned.\n>>\n>> git-svn insists on using http://svn.apache.org/repos/asf as the base \n>> URL, which is basically correct, but doesn't work for this repo.\n>>\n>> Even editing .git/config and .git/svn/metadata (after git svn init, \n>> befire the first fetch) to change the url doesn't help. git svn still \n>> uses .../asf. Is this as intended? cc'ing the git svn author.\n> \n> Can you try using the latest git-svn and also --no-follow-parent?\n> \n> --no-follow-parent won't traverse copy history so it may be faster,\n> but you'll get an incomplete history.\n> \n> On the other hand, it looks like the asf repo is hopelessly slow\n> for history retrieval.\n> \n> I'm pulling the asf log (svn log -v http://svn.apache.org/repos/asf >\n> tmp.log) but it's taking forever...  git-svn uses basically the same\n> operation as 'svn log -v' and I've yet to see an SVN server take this\n> long to show history.\n> \n> I've gotten 70,000 revisions after over one hour with the above svn log\n> command.  I'm going to restart this from a server with a better\n> connection since I need to power off this one when I sleep.\n\nNote that I'm not the OP, I'm just a git-svn user who got curious about \nthat post. I think the asf repo shows exactly those mistakes which svn \ndrives its users into (and which I've made also, on a much smaller \nscale, of course). As far as I understand, the synapse repo there is \nhistorical, and they need to convert to git in order to feed it into a \nCMS. I don't know if OP is still interested.\n\nMichael\n"}]}