{"thread":{"id":"52565","subject":"Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","startedAt":"2020-01-04T20:14:37Z","lastAt":"2020-02-09T00:58:28Z","messageCount":9,"participants":["John Paul Adrian Glaubitz","brian m. carlson","Thomas Braun"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"389221","messageId":"34ed7497-643e-5a38-d68c-7c075b647bcd@physik.fu-berlin.de","threadId":"52565","inReplyTo":null,"subject":"Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"John Paul Adrian Glaubitz","fromEmail":"glaubitz@physik.fu-berlin.de","sentAt":"2020-01-04T20:14:31Z","receivedAt":"2020-01-04T20:14:37Z","isPatch":false,"sender":{"key":"glaubitz@physik.fu-berlin.de","avatar":"https://avatars.githubusercontent.com/u/1647645?v=4"},"body":"Hi!\n\nIt seems that git is failing its testsuite on all 64-bit Big-Endian targets,\nfull build log can be found in [1]. There seem to be multiple failures.\n\nThe issue first showed with 2.25-rc1 [2].\n\nThanks,\nAdrian\n\n> [1] https://buildd.debian.org/status/fetch.php?pkg=git&arch=s390x&ver=1%3A2.25.0%7Erc1-1&stamp=1578096339&raw=0\n> [2] https://buildd.debian.org/status/logs.php?pkg=git&arch=s390x\n\n-- \n .''`.  John Paul Adrian Glaubitz\n: :' :  Debian Developer - glaubitz@debian.org\n`. `'   Freie Universitaet Berlin - glaubitz@physik.fu-berlin.de\n  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913\n"},{"id":"389223","messageId":"20200104205803.GE6570@camp.crustytoothpaste.net","threadId":"52565","inReplyTo":"34ed7497-643e-5a38-d68c-7c075b647bcd@physik.fu-berlin.de","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"brian m. carlson","fromEmail":"sandals@crustytoothpaste.net","sentAt":"2020-01-04T20:58:03Z","receivedAt":"2020-01-04T20:58:12Z","isPatch":false,"sender":{"key":"sandals@crustytoothpaste.net","avatar":"https://avatars.githubusercontent.com/u/497054?v=4"},"body":"On 2020-01-04 at 20:14:31, John Paul Adrian Glaubitz wrote:\n> Hi!\n> \n> It seems that git is failing its testsuite on all 64-bit Big-Endian targets,\n> full build log can be found in [1]. There seem to be multiple failures.\n> \n> The issue first showed with 2.25-rc1 [2].\n\nThis is interesting, because there are different failures on different\nplatforms.  s390x shows failures only in t9100, which is one of the svn\ntests.  From the diff between rc0 and rc1, I don't see anything which\nshould affect git-svn in that way.\n\nppc64 and sparc64 failing a lot more tests, mostly due to segfaults, but\nfrom a cursory glance they all appear to be SVN-related.\n\nAre we sure that some dependency of libsvn1 hasn't caused this problem?\nI noticed that all of the broken builds seem to have libserf-1-1\n1.3.9-8, which appears to have received an overhaul recently.  Of\ncourse, it could be something else as well.\n\nI got rid of my UltraSPARC hardware when I last moved, so I won't be\nlooking into this further, but it seems unlikely to me that the problem\nis in Git when the only non-Windows C change between the two versions is\na one-line file name change.\n-- \nbrian m. carlson: Houston, Texas, US\nOpenPGP: https://keybase.io/bk2204\n"},{"id":"389224","messageId":"980868cf-1362-b394-aa6c-f9153f259808@physik.fu-berlin.de","threadId":"52565","inReplyTo":"20200104205803.GE6570@camp.crustytoothpaste.net","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"John Paul Adrian Glaubitz","fromEmail":"glaubitz@physik.fu-berlin.de","sentAt":"2020-01-04T21:07:16Z","receivedAt":"2020-01-04T21:07:48Z","isPatch":false,"sender":{"key":"glaubitz@physik.fu-berlin.de","avatar":"https://avatars.githubusercontent.com/u/1647645?v=4"},"body":"Hi!\n\nOn 1/4/20 9:58 PM, brian m. carlson wrote:\n> I got rid of my UltraSPARC hardware when I last moved, so I won't be\n> looking into this further, but it seems unlikely to me that the problem\n> is in Git when the only non-Windows C change between the two versions is\n> a one-line file name change.\n\nYou can get access to a very fast SPARC porterbox through the GCC compile\nfarm [1]. Anyone can request a free account.\n\nAdrian\n\n> [1] https://gcc.gnu.org/wiki/CompileFarm\n\n-- \n .''`.  John Paul Adrian Glaubitz\n: :' :  Debian Developer - glaubitz@debian.org\n`. `'   Freie Universitaet Berlin - glaubitz@physik.fu-berlin.de\n  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913\n"},{"id":"389228","messageId":"b7565f06-55a2-7087-d46e-94f9e7ada988@physik.fu-berlin.de","threadId":"52565","inReplyTo":"34ed7497-643e-5a38-d68c-7c075b647bcd@physik.fu-berlin.de","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"John Paul Adrian Glaubitz","fromEmail":"glaubitz@physik.fu-berlin.de","sentAt":"2020-01-04T22:14:21Z","receivedAt":"2020-01-04T22:14:25Z","isPatch":false,"sender":{"key":"glaubitz@physik.fu-berlin.de","avatar":"https://avatars.githubusercontent.com/u/1647645?v=4"},"body":"Hi!\n\nOn 1/4/20 9:14 PM, John Paul Adrian Glaubitz wrote:\n> It seems that git is failing its testsuite on all 64-bit Big-Endian targets,\n> full build log can be found in [1]. There seem to be multiple failures.\n\nJust checked out git with git from github (SCNR ;)) and built and ran the\ntestsuite on ppc64, s390x and sparc64.\n\nppc64:\n\nmake aggregate-results\nmake[3]: Entering directory '/srv/glaubitz/git-git/t'\nfor f in 'test-results'/t*-*.counts; do \\\n        echo \"$f\"; \\\ndone | '/bin/sh' ./aggregate-results.sh\nfixed   0\nsuccess 20683\nfailed  0\nbroken  239\ntotal   21161\n\ns390x:\n\nmake aggregate-results\nmake[3]: Entering directory '/home/glaubitz/git/t'\nfor f in 'test-results'/t*-*.counts; do \\\n        echo \"$f\"; \\\ndone | '/bin/sh' ./aggregate-results.sh\nfixed   0\nsuccess 21298\nfailed  0\nbroken  249\ntotal   21760\n\nsparc64:\n\nmake aggregate-results\nmake[3]: Entering directory '/home/glaubitz/git/t'\nfor f in 'test-results'/t*-*.counts; do \\\n        echo \"$f\"; \\\ndone | '/bin/sh' ./aggregate-results.sh\nfixed   0\nsuccess 20703\nfailed  0\nbroken  239\ntotal   21176\n\nSo, it looks like the failures might be specific to the Debian package,\ndoesn't it? Where there maybe any recent commits that may have fixed\nthose issues?\n\nAdrian\n\n-- \n .''`.  John Paul Adrian Glaubitz\n: :' :  Debian Developer - glaubitz@debian.org\n`. `'   Freie Universitaet Berlin - glaubitz@physik.fu-berlin.de\n  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913\n"},{"id":"389229","messageId":"20200104224830.GF6570@camp.crustytoothpaste.net","threadId":"52565","inReplyTo":"b7565f06-55a2-7087-d46e-94f9e7ada988@physik.fu-berlin.de","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"brian m. carlson","fromEmail":"sandals@crustytoothpaste.net","sentAt":"2020-01-04T22:48:30Z","receivedAt":"2020-01-04T22:48:38Z","isPatch":false,"sender":{"key":"sandals@crustytoothpaste.net","avatar":"https://avatars.githubusercontent.com/u/497054?v=4"},"body":"On 2020-01-04 at 22:14:21, John Paul Adrian Glaubitz wrote:\n> Hi!\n> \n> On 1/4/20 9:14 PM, John Paul Adrian Glaubitz wrote:\n> > It seems that git is failing its testsuite on all 64-bit Big-Endian targets,\n> > full build log can be found in [1]. There seem to be multiple failures.\n> \n> Just checked out git with git from github (SCNR ;)) and built and ran the\n> testsuite on ppc64, s390x and sparc64.\n> \n> ppc64:\n> \n> make aggregate-results\n> make[3]: Entering directory '/srv/glaubitz/git-git/t'\n> for f in 'test-results'/t*-*.counts; do \\\n>         echo \"$f\"; \\\n> done | '/bin/sh' ./aggregate-results.sh\n> fixed   0\n> success 20683\n> failed  0\n> broken  239\n> total   21161\n> \n> s390x:\n> \n> make aggregate-results\n> make[3]: Entering directory '/home/glaubitz/git/t'\n> for f in 'test-results'/t*-*.counts; do \\\n>         echo \"$f\"; \\\n> done | '/bin/sh' ./aggregate-results.sh\n> fixed   0\n> success 21298\n> failed  0\n> broken  249\n> total   21760\n> \n> sparc64:\n> \n> make aggregate-results\n> make[3]: Entering directory '/home/glaubitz/git/t'\n> for f in 'test-results'/t*-*.counts; do \\\n>         echo \"$f\"; \\\n> done | '/bin/sh' ./aggregate-results.sh\n> fixed   0\n> success 20703\n> failed  0\n> broken  239\n> total   21176\n> \n> So, it looks like the failures might be specific to the Debian package,\n> doesn't it? Where there maybe any recent commits that may have fixed\n> those issues?\n\nDid you build your version of Git with Subversion support, and if so,\nwhich version of Subversion did you use (version of Debian package or\nother source)?  The tests that were failing all require git-svn, which\nin turn require libsvn-perl and subversion (/usr/bin/svn).  If you're\nmissing those packages, the Subversion tests will automatically be\nskipped.\n\nThe latest version on master is 2.25-rc1, and that's failing in the\nDebian package.  I haven't checked recently, but last I looked, the\nDebian package wasn't applying any additional patches on top of Git, so\nthe version you're getting off GitHub is literally the same version that\nyou're getting in the Debian package.\n-- \nbrian m. carlson: Houston, Texas, US\nOpenPGP: https://keybase.io/bk2204\n"},{"id":"389232","messageId":"4b4ae893-430f-6633-f0d9-0e89f9b89696@physik.fu-berlin.de","threadId":"52565","inReplyTo":"20200104224830.GF6570@camp.crustytoothpaste.net","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"John Paul Adrian Glaubitz","fromEmail":"glaubitz@physik.fu-berlin.de","sentAt":"2020-01-04T23:13:34Z","receivedAt":"2020-01-04T23:13:38Z","isPatch":false,"sender":{"key":"glaubitz@physik.fu-berlin.de","avatar":"https://avatars.githubusercontent.com/u/1647645?v=4"},"body":"Hi Brian!\n\nOn 1/4/20 11:48 PM, brian m. carlson wrote:\n> Did you build your version of Git with Subversion support, and if so,\n> which version of Subversion did you use (version of Debian package or\n> other source)?  The tests that were failing all require git-svn, which\n> in turn require libsvn-perl and subversion (/usr/bin/svn).  If you're\n> missing those packages, the Subversion tests will automatically be\n> skipped.\n\nGood point. I just ran the configure script without any extra options.\n\nI will have another look and make sure git-svn is enabled.\n\n> The latest version on master is 2.25-rc1, and that's failing in the\n> Debian package.  I haven't checked recently, but last I looked, the\n> Debian package wasn't applying any additional patches on top of Git, so\n> the version you're getting off GitHub is literally the same version that\n> you're getting in the Debian package.\n\nOkay. I wasn't sure whether there were any additional commits after the\n2.25-rc1 tag, I hadn't checked yet as I was doing these tests on the\nside while watching TV.\n\nAdrian\n\n-- \n .''`.  John Paul Adrian Glaubitz\n: :' :  Debian Developer - glaubitz@debian.org\n`. `'   Freie Universitaet Berlin - glaubitz@physik.fu-berlin.de\n  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913\n"},{"id":"389301","messageId":"2ce6a111-73ac-d8ac-e3a9-25286423535f@virtuell-zuhause.de","threadId":"52565","inReplyTo":"20200104205803.GE6570@camp.crustytoothpaste.net","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"Thomas Braun","fromEmail":"thomas.braun@virtuell-zuhause.de","sentAt":"2020-01-06T23:31:21Z","receivedAt":"2020-01-06T23:32:05Z","isPatch":false,"sender":{"key":"thomas.braun@virtuell-zuhause.de","avatar":"https://avatars.githubusercontent.com/u/1185677?v=4"},"body":"On 04.01.2020 21:58, brian m. carlson wrote:\n\n> I got rid of my UltraSPARC hardware when I last moved, so I won't be\n> looking into this further, but it seems unlikely to me that the problem\n> is in Git when the only non-Windows C change between the two versions is\n> a one-line file name change.\n> \n\nJust in case someone is interested. Last year I've created a QEMU image\nusing MIPS big-endian hardware [1]. It is still on debian stretch and\nlike **slow** but does not require additional hardware.\n\n[1]: https://github.com/t-b/debian-mips-qemu\n"},{"id":"389302","messageId":"4080b37c-5897-c58e-1741-ad18dfe3cb10@physik.fu-berlin.de","threadId":"52565","inReplyTo":"2ce6a111-73ac-d8ac-e3a9-25286423535f@virtuell-zuhause.de","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"John Paul Adrian Glaubitz","fromEmail":"glaubitz@physik.fu-berlin.de","sentAt":"2020-01-06T23:33:49Z","receivedAt":"2020-01-06T23:33:54Z","isPatch":false,"sender":{"key":"glaubitz@physik.fu-berlin.de","avatar":"https://avatars.githubusercontent.com/u/1647645?v=4"},"body":"On 1/7/20 12:31 AM, Thomas Braun wrote:\n> On 04.01.2020 21:58, brian m. carlson wrote:\n> \n>> I got rid of my UltraSPARC hardware when I last moved, so I won't be\n>> looking into this further, but it seems unlikely to me that the problem\n>> is in Git when the only non-Windows C change between the two versions is\n>> a one-line file name change.\n>>\n> \n> Just in case someone is interested. Last year I've created a QEMU image\n> using MIPS big-endian hardware [1]. It is still on debian stretch and\n> like **slow** but does not require additional hardware.\n\nFWIW, the GCC compile farm is supposed to get a new beefy MIPS server\nsoon as well so I have been told.\n\nBut as mentioned earlier, there is already a SPARC T5 in the GCC compile\nfarm which is open to use for any open-source developer [1].\n\nAdrian\n\n> [1] https://gcc.gnu.org/wiki/CompileFarm\n\n-- \n .''`.  John Paul Adrian Glaubitz\n: :' :  Debian Developer - glaubitz@debian.org\n`. `'   Freie Universitaet Berlin - glaubitz@physik.fu-berlin.de\n  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913\n"},{"id":"391385","messageId":"494689ca-c61f-47e0-c14a-28329a30f288@physik.fu-berlin.de","threadId":"52565","inReplyTo":"20200104224830.GF6570@camp.crustytoothpaste.net","subject":"Re: Testsuite failures on ppc64, sparc64 and s390x (64-bit BE)","fromName":"John Paul Adrian Glaubitz","fromEmail":"glaubitz@physik.fu-berlin.de","sentAt":"2020-02-09T00:58:20Z","receivedAt":"2020-02-09T00:58:28Z","isPatch":false,"sender":{"key":"glaubitz@physik.fu-berlin.de","avatar":"https://avatars.githubusercontent.com/u/1647645?v=4"},"body":"Hi!\n\nOn 1/4/20 11:48 PM, brian m. carlson wrote:\n> Did you build your version of Git with Subversion support, and if so,\n> which version of Subversion did you use (version of Debian package or\n> other source)?  The tests that were failing all require git-svn, which\n> in turn require libsvn-perl and subversion (/usr/bin/svn).  If you're\n> missing those packages, the Subversion tests will automatically be\n> skipped.\n> \n> The latest version on master is 2.25-rc1, and that's failing in the\n> Debian package.  I haven't checked recently, but last I looked, the\n> Debian package wasn't applying any additional patches on top of Git, so\n> the version you're getting off GitHub is literally the same version that\n> you're getting in the Debian package.\n\nI did some more testing and the failures are caused by sqlite3:\n\n(sid_ppc64-dchroot)root@redpanda:/build/git-ceFUyK/git-2.25.0+next.20200130/t# ./t9108-git-svn-glob.sh\nnot ok 1 - test refspec globbing\n#\n#               mkdir -p trunk/src/a trunk/src/b trunk/doc &&\n#               echo \"hello world\" > trunk/src/a/readme &&\n#               echo \"goodbye world\" > trunk/src/b/readme &&\n#               svn_cmd import -m \"initial\" trunk \"$svnrepo\"/trunk &&\n#               svn_cmd co \"$svnrepo\" tmp &&\n#               (\n#                       cd tmp &&\n#                       mkdir branches tags &&\n#                       svn_cmd add branches tags &&\n#                       svn_cmd cp trunk branches/start &&\n#                       svn_cmd commit -m \"start a new branch\" &&\n#                       svn_cmd up &&\n#                       echo \"hi\" >> branches/start/src/b/readme &&\n#                       poke branches/start/src/b/readme &&\n#                       echo \"hey\" >> branches/start/src/a/readme &&\n#                       poke branches/start/src/a/readme &&\n#                       svn_cmd commit -m \"hi\" &&\n#                       svn_cmd up &&\n#                       svn_cmd cp branches/start tags/end &&\n#                       echo \"bye\" >> tags/end/src/b/readme &&\n#                       poke tags/end/src/b/readme &&\n#                       echo \"aye\" >> tags/end/src/a/readme &&\n#                       poke tags/end/src/a/readme &&\n#                       svn_cmd commit -m \"the end\" &&\n#                       echo \"byebye\" >> tags/end/src/b/readme &&\n#                       poke tags/end/src/b/readme &&\n#                       svn_cmd commit -m \"nothing to see here\"\n#               ) &&\n#               git config --add svn-remote.svn.url \"$svnrepo\" &&\n#               git config --add svn-remote.svn.fetch \\\n#                                \"trunk/src/a:refs/remotes/trunk\" &&\n#               git config --add svn-remote.svn.branches \\\n#                                \"branches/*/src/a:refs/remotes/branches/*\" &&\n#               git config --add svn-remote.svn.tags\\\n#                                \"tags/*/src/a:refs/remotes/tags/*\" &&\n#               git svn multi-fetch &&\n#               git log --pretty=oneline refs/remotes/tags/end >actual &&\n#               sed -e \"s/^.\\{41\\}//\" actual >output.end &&\n#               test_cmp expect.end output.end &&\n#               test \"$(git rev-parse refs/remotes/tags/end~1)\" = \\\n#                       \"$(git rev-parse refs/remotes/branches/start)\" &&\n#               test \"$(git rev-parse refs/remotes/branches/start~2)\" = \\\n#                       \"$(git rev-parse refs/remotes/trunk)\" &&\n#               test_must_fail git rev-parse refs/remotes/tags/end@3\n#\nnot ok 2 - test left-hand-side only globbing\n#\n#               git config --add svn-remote.two.url \"$svnrepo\" &&\n#               git config --add svn-remote.two.fetch trunk:refs/remotes/two/trunk &&\n#               git config --add svn-remote.two.branches \\\n#                                \"branches/*:refs/remotes/two/branches/*\" &&\n#               git config --add svn-remote.two.tags \\\n#                                \"tags/*:refs/remotes/two/tags/*\" &&\n#               (\n#                       cd tmp &&\n#                       echo \"try try\" >> tags/end/src/b/readme &&\n#                       poke tags/end/src/b/readme &&\n#                       svn_cmd commit -m \"try to try\"\n#               ) &&\n#               git svn fetch two &&\n#               git rev-list refs/remotes/two/tags/end >actual &&\n#               test_line_count = 6 actual &&\n#               git rev-list refs/remotes/two/branches/start >actual &&\n#               test_line_count = 3 actual &&\n#               test $(git rev-parse refs/remotes/two/branches/start~2) = \\\n#                    $(git rev-parse refs/remotes/two/trunk) &&\n#               test $(git rev-parse refs/remotes/two/tags/end~3) = \\\n#                    $(git rev-parse refs/remotes/two/branches/start) &&\n#               git log --pretty=oneline refs/remotes/two/tags/end >actual &&\n#               sed -e \"s/^.\\{41\\}//\" actual >output.two &&\n#               test_cmp expect.two output.two\n#\nok 3 - prepare test disallow multi-globs\nnot ok 4 - test disallow multi-globs\n#\n#               git config --add svn-remote.three.url \"$svnrepo\" &&\n#               git config --add svn-remote.three.fetch \\\n#                                trunk:refs/remotes/three/trunk &&\n#               git config --add svn-remote.three.branches \\\n#                                \"branches/*/t/*:refs/remotes/three/branches/*\" &&\n#               git config --add svn-remote.three.tags \\\n#                                \"tags/*/*:refs/remotes/three/tags/*\" &&\n#               (\n#                       cd tmp &&\n#                       echo \"try try\" >> tags/end/src/b/readme &&\n#                       poke tags/end/src/b/readme &&\n#                       svn_cmd commit -m \"try to try\"\n#               ) &&\n#               test_must_fail git svn fetch three 2> stderr.three &&\n#               test_cmp expect.three stderr.three\n#\n# failed 3 among 4 test(s)\n1..4\n(sid_ppc64-dchroot)root@redpanda:/build/git-ceFUyK/git-2.25.0+next.20200130/t# dpkg -i /libsqlite3-0_3.30.1-1_ppc64.deb\ndpkg: warning: downgrading libsqlite3-0:ppc64 from 3.31.1-1 to 3.30.1-1\n(Reading database ... 30145 files and directories currently installed.)\nPreparing to unpack .../libsqlite3-0_3.30.1-1_ppc64.deb ...\nUnpacking libsqlite3-0:ppc64 (3.30.1-1) over (3.31.1-1) ...\nSetting up libsqlite3-0:ppc64 (3.30.1-1) ...\nProcessing triggers for libc-bin (2.29-10) ...\n(sid_ppc64-dchroot)root@redpanda:/build/git-ceFUyK/git-2.25.0+next.20200130/t# ./t9108-git-svn-glob.sh\nok 1 - test refspec globbing\nok 2 - test left-hand-side only globbing\nok 3 - prepare test disallow multi-globs\nok 4 - test disallow multi-globs\n# passed all 4 test(s)\n1..4\n(sid_ppc64-dchroot)root@redpanda:/build/git-ceFUyK/git-2.25.0+next.20200130/t#\n\nI will bisect sqlite3 tomorrow to find out when the regression was introduced.\n\nAdrian\n\n-- \n .''`.  John Paul Adrian Glaubitz\n: :' :  Debian Developer - glaubitz@debian.org\n`. `'   Freie Universitaet Berlin - glaubitz@physik.fu-berlin.de\n  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913\n"}]}