{"thread":{"id":"51147","subject":"[Breakage] 2.22.0-rc1 t5401-update-hooks.sh","startedAt":"2019-05-21T21:48:05Z","lastAt":"2019-05-23T21:00:41Z","messageCount":8,"participants":["Randall S. Becker","brian m. carlson","Johannes Schindelin"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"376020","messageId":"001501d5101e$db98dfb0$92ca9f10$@nexbridge.com","threadId":"51147","inReplyTo":null,"subject":"[Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Randall S. Becker","fromEmail":"rsbecker@nexbridge.com","sentAt":"2019-05-21T21:47:54Z","receivedAt":"2019-05-21T21:48:05Z","isPatch":false,"sender":{"key":"randall.becker@nexbridge.ca","avatar":"https://avatars.githubusercontent.com/u/28956764?v=4"},"body":"Another situation came up during regression testing on NonStop:\n\nt5401 broke on the first run through (most tests), with the failures below. \n\n*** t5401-update-hooks.sh ***\nnot ok 1 - setup\n#\n#               echo This is a test. >a &&\n#               git update-index --add a &&\n#               tree0=$(git write-tree) &&\n#               commit0=$(echo setup | git commit-tree $tree0) &&\n#               echo We hope it works. >a &&\n#               git update-index a &&\n#               tree1=$(git write-tree) &&\n#               commit1=$(echo modify | git commit-tree $tree1 -p $commit0)\n&&\n#               git update-ref refs/heads/master $commit0 &&\n#               git update-ref refs/heads/tofail $commit1 &&\n#               git clone --bare ./. victim.git &&\n#               GIT_DIR=victim.git git update-ref refs/heads/tofail $commit1\n&&\n#               git update-ref refs/heads/master $commit1 &&\n#               git update-ref refs/heads/tofail $commit0\n#\nt5401-update-hooks.sh: line 26: victim.git/hooks/pre-receive: No such file\nor di\nrectory\nchmod: cannot access 'victim.git/hooks/pre-receive': No such file or\ndirectory\nt5401-update-hooks.sh: line 35: victim.git/hooks/update: No such file or\ndirecto\nry\nchmod: cannot access 'victim.git/hooks/update': No such file or directory\nt5401-update-hooks.sh: line 45: victim.git/hooks/post-receive: No such file\nor d\nirectory\nchmod: cannot access 'victim.git/hooks/post-receive': No such file or\ndirectory\nt5401-update-hooks.sh: line 54: victim.git/hooks/post-update: No such file\nor di\nrectory\nchmod: cannot access 'victim.git/hooks/post-update': No such file or\ndirectory\nok 2 - push\netc.\n\nWhen running the test in isolation, it passes without incident whether or\nnot --verbose is used. So far, this only occurs on the first run through. I\nwanted to report it, based on the inconsistency of results. This is not the\nfirst time tests have acted in this fashion, and I realize it is difficult\nto do anything about it without being able to recreate the situation.\n\nSuch as it is,\nRandall\n\n"},{"id":"376034","messageId":"20190522004825.GC8616@genre.crustytoothpaste.net","threadId":"51147","inReplyTo":"001501d5101e$db98dfb0$92ca9f10$@nexbridge.com","subject":"Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"brian m. carlson","fromEmail":"sandals@crustytoothpaste.net","sentAt":"2019-05-22T00:48:26Z","receivedAt":"2019-05-22T00:48:49Z","isPatch":false,"sender":{"key":"sandals@crustytoothpaste.net","avatar":"https://avatars.githubusercontent.com/u/497054?v=4"},"body":"On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> When running the test in isolation, it passes without incident whether or\n> not --verbose is used. So far, this only occurs on the first run through. I\n> wanted to report it, based on the inconsistency of results. This is not the\n> first time tests have acted in this fashion, and I realize it is difficult\n> to do anything about it without being able to recreate the situation.\n\nDoes running git clean -dxf cause it to be reproducible?\n-- \nbrian m. carlson: Houston, Texas, US\nOpenPGP: https://keybase.io/bk2204\n"},{"id":"376060","messageId":"004301d510a4$bbe362e0$33aa28a0$@nexbridge.com","threadId":"51147","inReplyTo":"20190522004825.GC8616@genre.crustytoothpaste.net","subject":"RE: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Randall S. Becker","fromEmail":"rsbecker@nexbridge.com","sentAt":"2019-05-22T13:46:13Z","receivedAt":"2019-05-22T13:46:30Z","isPatch":false,"sender":{"key":"randall.becker@nexbridge.ca","avatar":"https://avatars.githubusercontent.com/u/28956764?v=4"},"body":"On May 21, 2019 20:48, brian m. carlson wrote:\n> To: Randall S. Becker <rsbecker@nexbridge.com>\n> Cc: 'Git Mailing List' <git@vger.kernel.org>\n> Subject: Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh\n> \n> On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> > When running the test in isolation, it passes without incident whether\n> > or not --verbose is used. So far, this only occurs on the first run\n> > through. I wanted to report it, based on the inconsistency of results.\n> > This is not the first time tests have acted in this fashion, and I\n> > realize it is difficult to do anything about it without being able to recreate\n> the situation.\n> \n> Does running git clean -dxf cause it to be reproducible?\n\nI will give it a go. Having exactly the same behaviour in t7519 subtest 19. I wonder whether there are breadcrumbs not being cleaned up. Will report back when I am able - may take a day or so.\n\nCheers,\nRandall\n\n\n"},{"id":"376114","messageId":"004e01d511a1$c521a120$4f64e360$@nexbridge.com","threadId":"51147","inReplyTo":"20190522004825.GC8616@genre.crustytoothpaste.net","subject":"RE: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Randall S. Becker","fromEmail":"rsbecker@nexbridge.com","sentAt":"2019-05-23T19:57:31Z","receivedAt":"2019-05-23T19:57:50Z","isPatch":false,"sender":{"key":"randall.becker@nexbridge.ca","avatar":"https://avatars.githubusercontent.com/u/28956764?v=4"},"body":"On May 21, 2019 20:48, brian m. carlson wrote:\n> To: Randall S. Becker <rsbecker@nexbridge.com>\n> Cc: 'Git Mailing List' <git@vger.kernel.org>\n> Subject: Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh\n> \n> On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> > When running the test in isolation, it passes without incident whether\n> > or not --verbose is used. So far, this only occurs on the first run\n> > through. I wanted to report it, based on the inconsistency of results.\n> > This is not the first time tests have acted in this fashion, and I\n> > realize it is difficult to do anything about it without being able to recreate\n> the situation.\n> \n> Does running git clean -dxf cause it to be reproducible?\n\nMade no difference. t5401 passed cleanly after a the clean -dxf. I don't know where the breadcrumbs are. I guess it could be something funky in the file system on platform or with bash.\n\n"},{"id":"376115","messageId":"nycvar.QRO.7.76.6.1905232203130.46@tvgsbejvaqbjf.bet","threadId":"51147","inReplyTo":"004301d510a4$bbe362e0$33aa28a0$@nexbridge.com","subject":"Issues with t7519.19, was RE: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Johannes Schindelin","fromEmail":"johannes.schindelin@gmx.de","sentAt":"2019-05-23T20:05:37Z","receivedAt":"2019-05-23T20:05:55Z","isPatch":false,"sender":{"key":"johannes.schindelin@gmx.de","avatar":"https://avatars.githubusercontent.com/u/127790?v=4"},"body":"Hi Randall,\n\nOn Wed, 22 May 2019, Randall S. Becker wrote:\n\n> On May 21, 2019 20:48, brian m. carlson wrote:\n> > To: Randall S. Becker <rsbecker@nexbridge.com>\n> > Cc: 'Git Mailing List' <git@vger.kernel.org>\n> > Subject: Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh\n> >\n> > On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> > > When running the test in isolation, it passes without incident\n> > > whether or not --verbose is used. So far, this only occurs on the\n> > > first run through. I wanted to report it, based on the inconsistency\n> > > of results. This is not the first time tests have acted in this\n> > > fashion, and I realize it is difficult to do anything about it\n> > > without being able to recreate\n> > the situation.\n> >\n> > Does running git clean -dxf cause it to be reproducible?\n>\n> I will give it a go. Having exactly the same behaviour in t7519 subtest\n> 19. I wonder whether there are breadcrumbs not being cleaned up. Will\n> report back when I am able - may take a day or so.\n\nI fear that t7519's problems are *completely* unrelated to the t5401 issue\nyou reported earlier. I hunted the t7519 problems down today, and I could\nimagine that these patches fix your t7519, too:\n\n\thttps://github.com/gitgitgadget/git/pull/223\n\nCiao,\nJohannes\n"},{"id":"376117","messageId":"006401d511a4$bdffbbe0$39ff33a0$@nexbridge.com","threadId":"51147","inReplyTo":"nycvar.QRO.7.76.6.1905232203130.46@tvgsbejvaqbjf.bet","subject":"RE: Issues with t7519.19, was RE: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Randall S. Becker","fromEmail":"rsbecker@nexbridge.com","sentAt":"2019-05-23T20:18:47Z","receivedAt":"2019-05-23T20:19:10Z","isPatch":false,"sender":{"key":"randall.becker@nexbridge.ca","avatar":"https://avatars.githubusercontent.com/u/28956764?v=4"},"body":"On May 23, 2019 16:06, Johannes Schindelin wrote:\n> On Wed, 22 May 2019, Randall S. Becker wrote:\n> \n> > On May 21, 2019 20:48, brian m. carlson wrote:\n> > > To: Randall S. Becker <rsbecker@nexbridge.com>\n> > > Cc: 'Git Mailing List' <git@vger.kernel.org>\n> > > Subject: Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh\n> > >\n> > > On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> > > > When running the test in isolation, it passes without incident\n> > > > whether or not --verbose is used. So far, this only occurs on the\n> > > > first run through. I wanted to report it, based on the\n> > > > inconsistency of results. This is not the first time tests have\n> > > > acted in this fashion, and I realize it is difficult to do\n> > > > anything about it without being able to recreate\n> > > the situation.\n> > >\n> > > Does running git clean -dxf cause it to be reproducible?\n> >\n> > I will give it a go. Having exactly the same behaviour in t7519\n> > subtest 19. I wonder whether there are breadcrumbs not being cleaned\n> > up. Will report back when I am able - may take a day or so.\n> \n> I fear that t7519's problems are *completely* unrelated to the t5401 issue\n> you reported earlier. I hunted the t7519 problems down today, and I could\n> imagine that these patches fix your t7519, too:\n> \n> \thttps://github.com/gitgitgadget/git/pull/223\n\nFrom the description, I believe it. Timestamp resolution on NonStop is in microseconds and those are not even slightly simulated. Coupled with this being an MPP not SMP, things can occur within the same microsecond, or in weird situations slightly before or after when comparing the clock on different CPUs. Yes, time-travel is possible at the single microsecond level 😉. Cores are synchronized, but our machine has 4 CPUs and synchronizing the file system across all of them does lead to slightly strange situations.\n\n"},{"id":"376125","messageId":"nycvar.QRO.7.76.6.1905232254200.46@tvgsbejvaqbjf.bet","threadId":"51147","inReplyTo":"006401d511a4$bdffbbe0$39ff33a0$@nexbridge.com","subject":"RE: Issues with t7519.19, was RE: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Johannes Schindelin","fromEmail":"johannes.schindelin@gmx.de","sentAt":"2019-05-23T20:55:18Z","receivedAt":"2019-05-23T20:55:36Z","isPatch":false,"sender":{"key":"johannes.schindelin@gmx.de","avatar":"https://avatars.githubusercontent.com/u/127790?v=4"},"body":"Hi Randall,\n\nOn Thu, 23 May 2019, Randall S. Becker wrote:\n\n> On May 23, 2019 16:06, Johannes Schindelin wrote:\n> > On Wed, 22 May 2019, Randall S. Becker wrote:\n> >\n> > > On May 21, 2019 20:48, brian m. carlson wrote:\n> > > > To: Randall S. Becker <rsbecker@nexbridge.com>\n> > > > Cc: 'Git Mailing List' <git@vger.kernel.org>\n> > > > Subject: Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh\n> > > >\n> > > > On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> > > > > When running the test in isolation, it passes without incident\n> > > > > whether or not --verbose is used. So far, this only occurs on the\n> > > > > first run through. I wanted to report it, based on the\n> > > > > inconsistency of results. This is not the first time tests have\n> > > > > acted in this fashion, and I realize it is difficult to do\n> > > > > anything about it without being able to recreate\n> > > > the situation.\n> > > >\n> > > > Does running git clean -dxf cause it to be reproducible?\n> > >\n> > > I will give it a go. Having exactly the same behaviour in t7519\n> > > subtest 19. I wonder whether there are breadcrumbs not being cleaned\n> > > up. Will report back when I am able - may take a day or so.\n> >\n> > I fear that t7519's problems are *completely* unrelated to the t5401 issue\n> > you reported earlier. I hunted the t7519 problems down today, and I could\n> > imagine that these patches fix your t7519, too:\n> >\n> > \thttps://github.com/gitgitgadget/git/pull/223\n>\n> From the description, I believe it. Timestamp resolution on NonStop is in microseconds and those are not even slightly simulated. Coupled with this being an MPP not SMP, things can occur within the same microsecond, or in weird situations slightly before or after when comparing the clock on different CPUs. Yes, time-travel is possible at the single microsecond level 😉. Cores are synchronized, but our machine has 4 CPUs and synchronizing the file system across all of them does lead to slightly strange situations.\n\nI tested my patches with\n\n\tsh t7519-status-fsmonitor.sh --stress-jobs=8 --stress-limit=10\n\nWhy don't you check out my branch, build and test, and then we know\nwhether it fixes your t7519 bug?\n\nCiao,\nJohannes\n"},{"id":"376126","messageId":"nycvar.QRO.7.76.6.1905232258280.46@tvgsbejvaqbjf.bet","threadId":"51147","inReplyTo":"004e01d511a1$c521a120$4f64e360$@nexbridge.com","subject":"RE: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh","fromName":"Johannes Schindelin","fromEmail":"johannes.schindelin@gmx.de","sentAt":"2019-05-23T21:00:23Z","receivedAt":"2019-05-23T21:00:41Z","isPatch":false,"sender":{"key":"johannes.schindelin@gmx.de","avatar":"https://avatars.githubusercontent.com/u/127790?v=4"},"body":"Hi Randall,\n\nOn Thu, 23 May 2019, Randall S. Becker wrote:\n\n> On May 21, 2019 20:48, brian m. carlson wrote:\n> > To: Randall S. Becker <rsbecker@nexbridge.com>\n> > Cc: 'Git Mailing List' <git@vger.kernel.org>\n> > Subject: Re: [Breakage] 2.22.0-rc1 t5401-update-hooks.sh\n> >\n> > On 2019-05-21 at 21:47:54, Randall S. Becker wrote:\n> > > When running the test in isolation, it passes without incident\n> > > whether or not --verbose is used. So far, this only occurs on the\n> > > first run through. I wanted to report it, based on the inconsistency\n> > > of results. This is not the first time tests have acted in this\n> > > fashion, and I realize it is difficult to do anything about it\n> > > without being able to recreate\n> > the situation.\n> >\n> > Does running git clean -dxf cause it to be reproducible?\n>\n> Made no difference. t5401 passed cleanly after a the clean -dxf. I don't\n> know where the breadcrumbs are. I guess it could be something funky in\n> the file system on platform or with bash.\n\nFWIW I do not see any of the major platforms having any sort of regression\nin t5401:\nhttps://dev.azure.com/gitgitgadget/git/_test/analytics?definitionId=4&contextType=build\n\nSo I guess the only way you will find out more about this issue is by\ninstrumenting the code and digging in. You will most likely find that the\n`--stress` mode will help you recreate the situation rather easily.\n\nCiao,\nJohannes\n"}]}