{"thread":{"id":"17270","subject":"git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","startedAt":"2009-01-20T15:46:52Z","lastAt":"2009-01-23T04:14:10Z","messageCount":7,"participants":["Kelly F. Hickel","Johannes Schindelin","Daniel Barkalow","Michael Haggerty"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"101261","messageId":"63BEA5E623E09F4D92233FB12A9F794302BC6851@emailmn.mqsoftware.com","threadId":"17270","inReplyTo":null,"subject":"git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Kelly F. Hickel","fromEmail":"kfh@mqsoftware.com","sentAt":"2009-01-20T15:46:52Z","receivedAt":"2009-01-20T15:46:52Z","isPatch":false,"sender":{"key":"kfh@mqsoftware.com","avatar":null},"body":"Hello all,\n\nBack in June I had done a test convert of our CVS repo using git 1.5.5.1\nand cvs2svn 2.2.0 that went reasonably well (although it takes nearly a\nweek to finish!). Recently I wanted to try again with the latest\nversions of git and cvs2svn.\n\nWhen I get to the final stage (running git fast-import to build the\nconverted repo), I get the following output:\ncat ../cvs2svn-tmp/git-blob.dat ../cvs2svn-tmp/git-dump.dat | git\nfast-import\nfatal: Unsupported command: '.\nfast-import: dumping crash report to .git/fast_import_crash_19097\n\nThe crash is 18MB and I'd rather not post it, but the only bits that\nseem somewhat interesting are:\nfast-import crash report:\n fast-import process: 19097\n parent process : 19095\n at Mon Jan 19 11:44:42 2009\n\nfatal: Unsupported command: '.\n\nMost Recent Commands Before Crash\n---------------------------------\n(...)\n reset refs/tags/T_9772\n from :1000007127\n reset refs/heads/TAG.FIXUP\n \n commit refs/heads/TAG.FIXUP\n mark :1000007128\n committer cvs2svn 1002043747 +0000\n data 88\n* '.\n\n\nHas anyone got any ideas how to resolve this?\n\nThanks,\n\n\n\n\n\n--\n\nKelly F. Hickel\nSenior Product Architect\nMQSoftware, Inc.\n952-345-8677 Office\n952-345-8721 Fax\nkfh@mqsoftware.com\nwww.mqsoftware.com\nCertified IBM SOA Specialty\nYour Full Service Provider for IBM WebSphere Learn more at\nwww.mqsoftware.com \n"},{"id":"101263","messageId":"63BEA5E623E09F4D92233FB12A9F794302BC6855@emailmn.mqsoftware.com","threadId":"17270","inReplyTo":"63BEA5E623E09F4D92233FB12A9F794302BC6851@emailmn.mqsoftware.com","subject":"RE: git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Kelly F. Hickel","fromEmail":"kfh@mqsoftware.com","sentAt":"2009-01-20T16:04:59Z","receivedAt":"2009-01-20T16:04:59Z","isPatch":false,"sender":{"key":"kfh@mqsoftware.com","avatar":null},"body":"> Back in June I had done a test convert of our CVS repo using git\n> 1.5.5.1\n> and cvs2svn 2.2.0 that went reasonably well \n\nThat's a typo. The June conversion used git 1.5.5.1 and cvs2svn 2.1.1\n(not 2.2.0 as previously stated).\n\nSorry for the confusion.\n\n-Kelly\n"},{"id":"101267","messageId":"alpine.DEB.1.00.0901201736210.5159@intel-tinevez-2-302","threadId":"17270","inReplyTo":"63BEA5E623E09F4D92233FB12A9F794302BC6851@emailmn.mqsoftware.com","subject":"Re: git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Johannes Schindelin","fromEmail":"johannes.schindelin@gmx.de","sentAt":"2009-01-20T16:41:23Z","receivedAt":"2009-01-20T16:41:23Z","isPatch":false,"sender":{"key":"johannes.schindelin@gmx.de","avatar":"https://avatars.githubusercontent.com/u/127790?v=4"},"body":"Hi,\n\nOn Tue, 20 Jan 2009, Kelly F. Hickel wrote:\n\n> cat ../cvs2svn-tmp/git-blob.dat ../cvs2svn-tmp/git-dump.dat | git\n> fast-import\n> fatal: Unsupported command: '.\n> fast-import: dumping crash report to .git/fast_import_crash_19097\n> \n> The crash is 18MB and I'd rather not post it, but the only bits that\n> seem somewhat interesting are:\n> fast-import crash report:\n> fast-import process: 19097\n> parent process : 19095\n> at Mon Jan 19 11:44:42 2009\n> \n> fatal: Unsupported command: '.\n> \n> Most Recent Commands Before Crash\n> ---------------------------------\n> (...)\n> reset refs/tags/T_9772\n> from :1000007127\n> reset refs/heads/TAG.FIXUP\n> \n> commit refs/heads/TAG.FIXUP\n> mark :1000007128\n> committer cvs2svn 1002043747 +0000\n> data 88\n> * '.\n> \n> \n\nThat is strange. The command \"data 88\" should read the next 88 bytes and \nnot stop at the line starting with '.\n\nJust to test, I successfully imported this:\n\n-- snip --\ncommit refs/heads/testing/test\nmark :1\ncommitter cvs2svn 1002043747 +0000\ndata 3\n'.\n\n-- snap --\n\nSo I guess the problem lies much earlier: I could imagine that there is \n_another_ \"data\" command that has a bogus length and just happens to end \nafter the line \"data 88\".\n\nMaybe that helps?\n\nI could also imagine that the '. actually is the end of an example \ninside a blob, that literally looks like a fast-import script, but \nactually is not meant for _this_ fast-import run.\n\nCiao,\nDscho\n"},{"id":"101297","messageId":"alpine.LNX.1.00.0901201522250.19665@iabervon.org","threadId":"17270","inReplyTo":"63BEA5E623E09F4D92233FB12A9F794302BC6851@emailmn.mqsoftware.com","subject":"Re: git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Daniel Barkalow","fromEmail":"barkalow@iabervon.org","sentAt":"2009-01-20T20:29:08Z","receivedAt":"2009-01-20T20:29:08Z","isPatch":false,"sender":{"key":"barkalow@iabervon.org","avatar":"https://avatars.githubusercontent.com/u/55364219?v=4"},"body":"On Tue, 20 Jan 2009, Kelly F. Hickel wrote:\n\n> Hello all,\n> \n> Back in June I had done a test convert of our CVS repo using git 1.5.5.1\n> and cvs2svn 2.2.0 that went reasonably well (although it takes nearly a\n> week to finish!). Recently I wanted to try again with the latest\n> versions of git and cvs2svn.\n> \n> When I get to the final stage (running git fast-import to build the\n> converted repo), I get the following output:\n> cat ../cvs2svn-tmp/git-blob.dat ../cvs2svn-tmp/git-dump.dat | git\n> fast-import\n> fatal: Unsupported command: '.\n> fast-import: dumping crash report to .git/fast_import_crash_19097\n> \n> The crash is 18MB and I'd rather not post it, but the only bits that\n> seem somewhat interesting are:\n> fast-import crash report:\n> fast-import process: 19097\n> parent process : 19095\n> at Mon Jan 19 11:44:42 2009\n> \n> fatal: Unsupported command: '.\n> \n> Most Recent Commands Before Crash\n> ---------------------------------\n> (...)\n> reset refs/tags/T_9772\n> from :1000007127\n> reset refs/heads/TAG.FIXUP\n> \n> commit refs/heads/TAG.FIXUP\n> mark :1000007128\n> committer cvs2svn 1002043747 +0000\n> data 88\n> * '.\n> \n> \n> Has anyone got any ideas how to resolve this?\n\nCan you find that part of the input? I wouldn't be too surprised if \nsomething were giving the wrong length in a data command, causing it to \neither eat another data command and end up in the data or to use \nnot-quite-all of the data and end up near the end of the data.\n\n\t-Daniel\n*This .sig left intentionally blank*\n"},{"id":"101530","messageId":"63BEA5E623E09F4D92233FB12A9F794302BC6921@emailmn.mqsoftware.com","threadId":"17270","inReplyTo":"63BEA5E623E09F4D92233FB12A9F794302BC6855@emailmn.mqsoftware.com","subject":"RE: git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Kelly F. Hickel","fromEmail":"kfh@mqsoftware.com","sentAt":"2009-01-22T14:30:39Z","receivedAt":"2009-01-22T14:30:39Z","isPatch":false,"sender":{"key":"kfh@mqsoftware.com","avatar":null},"body":"(Sorry for the mangled quotes)\n\n> That is strange. The command \"data 88\" should read the next 88 bytes\nand \n> not stop at the line starting with '. \n> \n> Just to test, I successfully imported this: \n> \n> -- snip -- \n> commit refs/heads/testing/test \n> mark :1 \n> committer cvs2svn 1002043747 +0000 \n> data 3 \n> '. \n> \n> -- snap -- \n> \n> So I guess the problem lies much earlier: I could imagine that there\nis \n> _another_ \"data\" command that has a bogus length and just happens to\nend \n> after the line \"data 88\". \n> \n> Maybe that helps? \n> \n> I could also imagine that the '. actually is the end of an example \n> inside a blob, that literally looks like a fast-import script, but \n> actually is not meant for _this_ fast-import run. \n> \n> Ciao, \n> Dscho \n> \n> -- \n> To unsubscribe from this list: send the line \"unsubscribe git\" in \n> the body of a message to majordomo@... \n> More majordomo info at http://vger.kernel.org/majordomo-info.html \n\n\n> \n> From: Daniel Barkalow \n> Can you find that part of the input? I wouldn't be too surprised if \n> something were giving the wrong length in a data command, causing it\nto \n> either eat another data command and end up in the data or to use \n> not-quite-all of the data and end up near the end of the data. \n> \n> -Daniel \n> *This .sig left intentionally blank* \n> \n>\n\nI found the section in question, it is:\n-- snip --\ncommit refs/heads/TAG.FIXUP\nmark :1000007128\ncommitter cvs2svn 1002043747 +0000\ndata 88\nThis commit was manufactured by cvs2svn to create tag\n'T_BU_Problem_9xxx_Merge_3-21-2000'.\nmerge :1000007126\nM 100755 :180810 mfcdev/Domedit/DlgAddAlias.h\n-- snap --\n\nBy my count, 88 is the ending single quote character, leaving the '.' to\nbe interpreted as a command.\n\nLooks like I should go post this on the cvs2svn list.....\n\n\nThanks!\n\n\n--\nKelly F. Hickel\nSenior Product Architect\nMQSoftware, Inc.\n952-345-8677 Office\n952-345-8721 Fax\nkfh@mqsoftware.com\nwww.mqsoftware.com\nCertified IBM SOA Specialty\nYour Full Service Provider for IBM WebSphere\nLearn more at www.mqsoftware.com \n"},{"id":"101537","messageId":"alpine.DEB.1.00.0901221729130.3586@pacific.mpi-cbg.de","threadId":"17270","inReplyTo":"63BEA5E623E09F4D92233FB12A9F794302BC6921@emailmn.mqsoftware.com","subject":"RE: git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Johannes Schindelin","fromEmail":"johannes.schindelin@gmx.de","sentAt":"2009-01-22T16:31:20Z","receivedAt":"2009-01-22T16:31:20Z","isPatch":false,"sender":{"key":"johannes.schindelin@gmx.de","avatar":"https://avatars.githubusercontent.com/u/127790?v=4"},"body":"Hi,\n\nOn Thu, 22 Jan 2009, Kelly F. Hickel wrote:\n\n> I found the section in question, it is:\n> -- snip --\n> commit refs/heads/TAG.FIXUP\n> mark :1000007128\n> committer cvs2svn 1002043747 +0000\n> data 88\n> This commit was manufactured by cvs2svn to create tag\n> 'T_BU_Problem_9xxx_Merge_3-21-2000'.\n> merge :1000007126\n> M 100755 :180810 mfcdev/Domedit/DlgAddAlias.h\n> -- snap --\n> \n> By my count, 88 is the ending single quote character, leaving the '.' to\n> be interpreted as a command.\n\nGreat!\n\n> Looks like I should go post this on the cvs2svn list.....\n\nIndeed. I think that Michael will find the culprit very soon, with this \ndetailed report.\n\nBTW for future reference, please Cc: the people you are responding to. \nThe Git mailing list is a high volume list, and people will miss you \nanswers otherwise.\n\nThanks,\nDscho\n"},{"id":"101606","messageId":"49794412.8070909@alum.mit.edu","threadId":"17270","inReplyTo":"63BEA5E623E09F4D92233FB12A9F794302BC6921@emailmn.mqsoftware.com","subject":"Re: git fast-import problem converting from CVS with git 1.6.1 and cvs2svn 2.2.0","fromName":"Michael Haggerty","fromEmail":"mhagger@alum.mit.edu","sentAt":"2009-01-23T04:14:10Z","receivedAt":"2009-01-23T04:14:10Z","isPatch":false,"sender":{"key":"mhagger@alum.mit.edu","avatar":"https://avatars.githubusercontent.com/u/119718?v=4"},"body":"Kelly F. Hickel wrote:\n> I found the section in question, it is:\n> -- snip --\n> commit refs/heads/TAG.FIXUP\n> mark :1000007128\n> committer cvs2svn 1002043747 +0000\n> data 88\n> This commit was manufactured by cvs2svn to create tag\n> 'T_BU_Problem_9xxx_Merge_3-21-2000'.\n> merge :1000007126\n> M 100755 :180810 mfcdev/Domedit/DlgAddAlias.h\n> -- snap --\n> \n> By my count, 88 is the ending single quote character, leaving the '.' to\n> be interpreted as a command.\n> \n> Looks like I should go post this on the cvs2svn list.....\n\nYes, that would be helpful. Please include enough information and data\nto enable me to reproduce your problem, because it is very mysterious.\n\nThe lines in question are (in Python)\n\n self.f.write('data %d\\n' % (len(log_msg),))\n self.f.write('%s\\n' % (log_msg,))\n\nwhere self.f is a file that was opened in binary mode, and log_msg is an\n8-bit or unicode string. Since the log message is being output to a\nbinary file, f.write() should squeal if the string includes any\nnon-ascii characters (I just verified this with Python 2.2, 2.4, and\n2.5). Nevertheless, I suspect that your problem is caused by some kind\nof character encoding problem, perhaps dependent on platform or Python\nversion.\n\nYou might also try the trunk version of cvs2svn; there have been a lot\nof changes to cvs2git since release 2.1.1--even a new command that is\nactually called cvs2git! (though for now you still need to use an\noptions file to start conversions).\n\nMichael\n\n------------------------------------------------------\nhttp://cvs2svn.tigris.org/ds/viewMessage.do?dsForumId=1670&dsMessageId=1044191\n\nTo unsubscribe from this discussion, e-mail: [users-unsubscribe@cvs2svn.tigris.org].\n"}]}