{"thread":{"id":"31972","subject":"Re: Git clone fails with \"bad pack header\", how to get remote log","startedAt":"2012-10-29T17:18:54Z","lastAt":"2012-11-01T15:38:02Z","messageCount":9,"participants":["Konstantin Khomoutov","kevin molcard","Jeff King"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"202128","messageId":"20121029211854.b58c791d30a6c8d68665e574@domain007.com","threadId":"31972","inReplyTo":"7f498800-ed38-474d-86ad-cb937be68173-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org","subject":"Re: Git clone fails with \"bad pack header\", how to get remote log","fromName":"Konstantin Khomoutov","fromEmail":"flatworm-rn4veauk+akrv+lv9mx5uipxlwaovq5f@public.gmane.org","sentAt":"2012-10-29T17:18:54Z","receivedAt":"2012-10-29T17:18:54Z","isPatch":false,"sender":{"key":"flatworm-rn4veauk+akrv+lv9mx5uipxlwaovq5f@public.gmane.org","avatar":null},"body":"On Mon, 29 Oct 2012 09:52:54 -0700 (PDT)\nKevin Molcard wrote:\n\n> I have a problem with my build system.\n> \n> I have a remote server with a relatively large repository (around 12\n> GB, each branch having a size of 3 GB). \n> \n> I have also 2 build servers (Mac, Windows) that are cloning the repo\n> from the remote.\n> \n> Sometimes (very often when several git clone are sent at the same\n> time), I have the following error:\n> \n> remote: internal server error\n> fatal: protocol error: bad pack header\n> \n> I know that it happens when the remote is compressing objects (thanks\n> to `--progress -v` flags) because the last line of the log before the\n> erro is: \n> remote: Compressing objects: 93% (17959/19284) [K\n> \n> * So I have 2 questions, does anybody what is the problem and what\n> should I do?\n> * Is there a way to get a more precise log from the remote to debug\n> this problem?\n\nThis reminds me of a bug fixed in 1.7.12.1 [1]:\n\n* When \"git push\" triggered the automatic gc on the receiving end, a\n message from \"git prune\" that said it was removing cruft leaked to\n the standard output, breaking the communication protocol.\n\nIn any case, bugs should be reported to the main Git list (which is\ngit at vger.kernel.org), not here.\nI'm Cc'ing the main Git list so you'll get any responses from there, if\nany.\n\nKevin, please answer to this message (keeping all the Ccs -- use \"Reply\nto group\" or \"Reply to all\" in your MUA) and describe exactly what Git\nversions on which platforms your have.\n\n1. https://raw.github.com/git/git/master/Documentation/RelNotes/1.7.12.1.txt\n\n-- \nYou received this message because you are subscribed to the Google Groups \"Git for human beings\" group.\nTo post to this group, send email to git-users-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org\nTo unsubscribe from this group, send email to git-users+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org\nFor more options, visit this group at http://groups.google.com/group/git-users?hl=en.\n"},{"id":"202181","messageId":"508F7B38.5020603@gmail.com","threadId":"31972","inReplyTo":"20121029211854.b58c791d30a6c8d68665e574@domain007.com","subject":"Re: [git-users] Git clone fails with \"bad pack header\", how to get remote log","fromName":"kevin molcard","fromEmail":"kev2041@gmail.com","sentAt":"2012-10-30T07:01:12Z","receivedAt":"2012-10-30T07:01:12Z","isPatch":false,"sender":{"key":"kev2041@gmail.com","avatar":null},"body":"Hi Konstantin,\n\nthanks for the reply.\nThe versions of git are:\n- on remote: 1.5.6.5\n- on windows build machine: 1.7.11.msysgit.1\n- on mac build machine: 1.7.3.4\n\nI will try to install latest git version on my remote server and get \nback to you.\n\nthanks again\nKevin\n\nOn 10/29/12 6:18 PM, Konstantin Khomoutov wrote:\n> On Mon, 29 Oct 2012 09:52:54 -0700 (PDT)\n> Kevin Molcard wrote:\n>\n>> I have a problem with my build system.\n>>\n>> I have a remote server with a relatively large repository (around 12\n>> GB, each branch having a size of 3 GB).\n>>\n>> I have also 2 build servers (Mac, Windows) that are cloning the repo\n>> from the remote.\n>>\n>> Sometimes (very often when several git clone are sent at the same\n>> time), I have the following error:\n>> \n>> remote: internal server error\n>> fatal: protocol error: bad pack header\n>>\n>> I know that it happens when the remote is compressing objects (thanks\n>> to `--progress -v` flags) because the last line of the log before the\n>> erro is:\n>> remote: Compressing objects: 93% (17959/19284) [K\n>>\n>> * So I have 2 questions, does anybody what is the problem and what\n>> should I do?\n>> * Is there a way to get a more precise log from the remote to debug\n>> this problem?\n> This reminds me of a bug fixed in 1.7.12.1 [1]:\n>\n> * When \"git push\" triggered the automatic gc on the receiving end, a\n> message from \"git prune\" that said it was removing cruft leaked to\n> the standard output, breaking the communication protocol.\n>\n> In any case, bugs should be reported to the main Git list (which is\n> git at vger.kernel.org), not here.\n> I'm Cc'ing the main Git list so you'll get any responses from there, if\n> any.\n>\n> Kevin, please answer to this message (keeping all the Ccs -- use \"Reply\n> to group\" or \"Reply to all\" in your MUA) and describe exactly what Git\n> versions on which platforms your have.\n>\n> 1. https://raw.github.com/git/git/master/Documentation/RelNotes/1.7.12.1.txt\n>\n"},{"id":"202203","messageId":"508FEAE0.20204@gmail.com","threadId":"31972","inReplyTo":"20121029211854.b58c791d30a6c8d68665e574-g5ZlayWIM10NZ+ppGFcyYQ@public.gmane.org","subject":"Re: Git clone fails with \"bad pack header\", how to get remote log","fromName":"kevin molcard","fromEmail":"kev2041-re5jqeeqqe8avxtiumwx3w@public.gmane.org","sentAt":"2012-10-30T14:57:36Z","receivedAt":"2012-10-30T14:57:36Z","isPatch":false,"sender":{"key":"kev2041-re5jqeeqqe8avxtiumwx3w@public.gmane.org","avatar":null},"body":"I tried to install git 1.8 on the remote server and get exactly the same \nproblem :(.\n\nKevin\n\nOn 10/29/12 6:18 PM, Konstantin Khomoutov wrote:\n> On Mon, 29 Oct 2012 09:52:54 -0700 (PDT)\n> Kevin Molcard wrote:\n>\n>> I have a problem with my build system.\n>>\n>> I have a remote server with a relatively large repository (around 12\n>> GB, each branch having a size of 3 GB).\n>>\n>> I have also 2 build servers (Mac, Windows) that are cloning the repo\n>> from the remote.\n>>\n>> Sometimes (very often when several git clone are sent at the same\n>> time), I have the following error:\n>> \n>> remote: internal server error\n>> fatal: protocol error: bad pack header\n>>\n>> I know that it happens when the remote is compressing objects (thanks\n>> to `--progress -v` flags) because the last line of the log before the\n>> erro is:\n>> remote: Compressing objects: 93% (17959/19284) [K\n>>\n>> * So I have 2 questions, does anybody what is the problem and what\n>> should I do?\n>> * Is there a way to get a more precise log from the remote to debug\n>> this problem?\n> This reminds me of a bug fixed in 1.7.12.1 [1]:\n>\n> * When \"git push\" triggered the automatic gc on the receiving end, a\n> message from \"git prune\" that said it was removing cruft leaked to\n> the standard output, breaking the communication protocol.\n>\n> In any case, bugs should be reported to the main Git list (which is\n> git at vger.kernel.org), not here.\n> I'm Cc'ing the main Git list so you'll get any responses from there, if\n> any.\n>\n> Kevin, please answer to this message (keeping all the Ccs -- use \"Reply\n> to group\" or \"Reply to all\" in your MUA) and describe exactly what Git\n> versions on which platforms your have.\n>\n> 1. https://raw.github.com/git/git/master/Documentation/RelNotes/1.7.12.1.txt\n>\n\n-- \nYou received this message because you are subscribed to the Google Groups \"Git for human beings\" group.\nTo post to this group, send email to git-users-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org\nTo unsubscribe from this group, send email to git-users+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org\nFor more options, visit this group at http://groups.google.com/group/git-users?hl=en.\n"},{"id":"202315","messageId":"509132FD.5000803@gmail.com","threadId":"31972","inReplyTo":"20121029211854.b58c791d30a6c8d68665e574@domain007.com","subject":"Fwd: Re: [git-users] Git clone fails with \"bad pack header\", how to get remote log","fromName":"kevin molcard","fromEmail":"kev2041@gmail.com","sentAt":"2012-10-31T14:17:33Z","receivedAt":"2012-10-31T14:17:33Z","isPatch":false,"sender":{"key":"kev2041@gmail.com","avatar":null},"body":"Hi all,\nI am forwarding a reply I got from a message I sent to git user mailing \nlist because of a \"bad pack header error\" (more information below).\nI will forward another email where I give all the git versions of my system.\n\nAny clue on this would be much appreciated.\n\nThanks in advance\nKevin\n\n\n-------- Original Message --------\nSubject: \tRe: [git-users] Git clone fails with \"bad pack header\", how to \nget remote log\nDate: \tMon, 29 Oct 2012 21:18:54 +0400\nFrom: \tKonstantin Khomoutov \nTo: \tgit-users@googlegroups.com\nCC: \tKevin Molcard , git@vger.kernel.org\n\n\n\nOn Mon, 29 Oct 2012 09:52:54 -0700 (PDT)\nKevin Molcard wrote:\n\n> I have a problem with my build system.\n>\n> I have a remote server with a relatively large repository (around 12\n> GB, each branch having a size of 3 GB).\n>\n> I have also 2 build servers (Mac, Windows) that are cloning the repo\n> from the remote.\n>\n> Sometimes (very often when several git clone are sent at the same\n> time), I have the following error:\n>\n> remote: internal server error\n> fatal: protocol error: bad pack header\n>\n> I know that it happens when the remote is compressing objects (thanks\n> to `--progress -v` flags) because the last line of the log before the\n> erro is:\n> remote: Compressing objects: 93% (17959/19284) [K\n>\n> * So I have 2 questions, does anybody what is the problem and what\n> should I do?\n> * Is there a way to get a more precise log from the remote to debug\n> this problem?\n\nThis reminds me of a bug fixed in 1.7.12.1 [1]:\n\n* When \"git push\" triggered the automatic gc on the receiving end, a\n message from \"git prune\" that said it was removing cruft leaked to\n the standard output, breaking the communication protocol.\n\nIn any case, bugs should be reported to the main Git list (which is\ngit at vger.kernel.org), not here.\nI'm Cc'ing the main Git list so you'll get any responses from there, if\nany.\n\nKevin, please answer to this message (keeping all the Ccs -- use \"Reply\nto group\" or \"Reply to all\" in your MUA) and describe exactly what Git\nversions on which platforms your have.\n\n1. https://raw.github.com/git/git/master/Documentation/RelNotes/1.7.12.1.txt\n"},{"id":"202316","messageId":"20121031141955.GC24291@sigill.intra.peff.net","threadId":"31972","inReplyTo":"508FEAE0.20204@gmail.com","subject":"Re: [git-users] Git clone fails with \"bad pack header\", how to get remote log","fromName":"Jeff King","fromEmail":"peff@peff.net","sentAt":"2012-10-31T14:19:55Z","receivedAt":"2012-10-31T14:19:55Z","isPatch":false,"sender":{"key":"peff@peff.net","avatar":"https://avatars.githubusercontent.com/u/45925?v=4"},"body":"On Tue, Oct 30, 2012 at 03:57:36PM +0100, kevin molcard wrote:\n\n> I tried to install git 1.8 on the remote server and get exactly the\n> same problem :(.\n> [...]\n> >>Sometimes (very often when several git clone are sent at the same\n> >>time), I have the following error:\n> >> remote: internal server error\n> >> fatal: protocol error: bad pack header\n\nI'm very confused about who is printing \"internal server error\". The\n\"remote:\" indicates that it came to the git client via the sideband,\nwhich means it probably came from the stderr of a child process (e.g.,\npack-objects). But git does not and has never generated the phrase\n\"internal server error\".\n\nSo what program is producing that? Is there some kind of custom layer\nthat might be run when upload-pack runs \"git pack-objects ...\"? Can you\ntry running strace on the server?\n\n-Peff\n"},{"id":"202318","messageId":"509134D9.1050705@gmail.com","threadId":"31972","inReplyTo":"20121031141955.GC24291-bBVMEuqLR+SYVEpFpFwlB0AkDMvbqDRI@public.gmane.org","subject":"Re: Git clone fails with \"bad pack header\", how to get remote log","fromName":"kevin molcard","fromEmail":"kev2041-re5jqeeqqe8avxtiumwx3w@public.gmane.org","sentAt":"2012-10-31T14:25:29Z","receivedAt":"2012-10-31T14:25:29Z","isPatch":false,"sender":{"key":"kev2041-re5jqeeqqe8avxtiumwx3w@public.gmane.org","avatar":null},"body":"Yes I can,\ncan you tell me how I have to do that?\n\nthanks\nKevin\nOn 10/31/12 3:19 PM, Jeff King wrote:\n> On Tue, Oct 30, 2012 at 03:57:36PM +0100, kevin molcard wrote:\n>\n>> I tried to install git 1.8 on the remote server and get exactly the\n>> same problem :(.\n>> [...]\n>>>> Sometimes (very often when several git clone are sent at the same\n>>>> time), I have the following error:\n>>>> remote: internal server error\n>>>> fatal: protocol error: bad pack header\n> I'm very confused about who is printing \"internal server error\". The\n> \"remote:\" indicates that it came to the git client via the sideband,\n> which means it probably came from the stderr of a child process (e.g.,\n> pack-objects). But git does not and has never generated the phrase\n> \"internal server error\".\n>\n> So what program is producing that? Is there some kind of custom layer\n> that might be run when upload-pack runs \"git pack-objects ...\"? Can you\n> try running strace on the server?\n>\n> -Peff\n>\n\n-- \n"},{"id":"202319","messageId":"509136EE.6040705@gmail.com","threadId":"31972","inReplyTo":"20121031141955.GC24291-bBVMEuqLR+SYVEpFpFwlB0AkDMvbqDRI@public.gmane.org","subject":"Re: Git clone fails with \"bad pack header\", how to get remote log","fromName":"kevin molcard","fromEmail":"kev2041-re5jqeeqqe8avxtiumwx3w@public.gmane.org","sentAt":"2012-10-31T14:34:22Z","receivedAt":"2012-10-31T14:34:22Z","isPatch":false,"sender":{"key":"kev2041-re5jqeeqqe8avxtiumwx3w@public.gmane.org","avatar":null},"body":"I forgot to mention that I am using scm manager:\nhttps://bitbucket.org/sdorra/scm-manager/wiki/Home\n\nSo that maybe the \" custom layer you are talking about.\n\nKevin\n\nOn 10/31/12 3:19 PM, Jeff King wrote:\n> On Tue, Oct 30, 2012 at 03:57:36PM +0100, kevin molcard wrote:\n>\n>> I tried to install git 1.8 on the remote server and get exactly the\n>> same problem :(.\n>> [...]\n>>>> Sometimes (very often when several git clone are sent at the same\n>>>> time), I have the following error:\n>>>> remote: internal server error\n>>>> fatal: protocol error: bad pack header\n> I'm very confused about who is printing \"internal server error\". The\n> \"remote:\" indicates that it came to the git client via the sideband,\n> which means it probably came from the stderr of a child process (e.g.,\n> pack-objects). But git does not and has never generated the phrase\n> \"internal server error\".\n>\n> So what program is producing that? Is there some kind of custom layer\n> that might be run when upload-pack runs \"git pack-objects ...\"? Can you\n> try running strace on the server?\n>\n> -Peff\n>\n\n-- \n"},{"id":"202364","messageId":"20121101111544.GA19996@sigill.intra.peff.net","threadId":"31972","inReplyTo":"509136EE.6040705@gmail.com","subject":"Re: [git-users] Git clone fails with \"bad pack header\", how to get remote log","fromName":"Jeff King","fromEmail":"peff@peff.net","sentAt":"2012-11-01T11:15:44Z","receivedAt":"2012-11-01T11:15:44Z","isPatch":false,"sender":{"key":"peff@peff.net","avatar":"https://avatars.githubusercontent.com/u/45925?v=4"},"body":"On Wed, Oct 31, 2012 at 03:34:22PM +0100, kevin molcard wrote:\n\n> I forgot to mention that I am using scm manager:\n> https://bitbucket.org/sdorra/scm-manager/wiki/Home\n> \n> So that maybe the \" custom layer you are talking about.\n\nYeah, that is very important. If I am reading the scm-manager code right\n(and I might not be, as I only just looked at it), it is built entirely\naround JGit, and is not calling git-core programs at all. So it is\neither an issue in scm-manager, or in JGit.\n\nYour best bet is probably to report the issue to the scm-manager folks,\nwho can probably help you dig into the problem further (it may even have\nmore detailed logs of what happened, but I don't know).\n\n-Peff\n"},{"id":"202370","messageId":"CADjTjYYqYYOOYCC3+fUXLvQieAEEt33x2MfEYobSbETy1PcVFA@mail.gmail.com","threadId":"31972","inReplyTo":"20121101111544.GA19996@sigill.intra.peff.net","subject":"Re: [git-users] Git clone fails with \"bad pack header\", how to get remote log","fromName":"kevin molcard","fromEmail":"kev2041@gmail.com","sentAt":"2012-11-01T15:38:02Z","receivedAt":"2012-11-01T15:38:02Z","isPatch":false,"sender":{"key":"kev2041@gmail.com","avatar":null},"body":"Hi Peff,\nthanks for this information.\nI will report the issue to scm-manager. In the meantime I will try to\nuse ssh protocol to connect to my remote server.\n\nThanks again,\nKevin\n\n2012/11/1 Jeff King :\n> On Wed, Oct 31, 2012 at 03:34:22PM +0100, kevin molcard wrote:\n>\n>> I forgot to mention that I am using scm manager:\n>> https://bitbucket.org/sdorra/scm-manager/wiki/Home\n>>\n>> So that maybe the \" custom layer you are talking about.\n>\n> Yeah, that is very important. If I am reading the scm-manager code right\n> (and I might not be, as I only just looked at it), it is built entirely\n> around JGit, and is not calling git-core programs at all. So it is\n> either an issue in scm-manager, or in JGit.\n>\n> Your best bet is probably to report the issue to the scm-manager folks,\n> who can probably help you dig into the problem further (it may even have\n> more detailed logs of what happened, but I don't know).\n>\n> -Peff\n"}]}