{"thread":{"id":"50702","subject":"t0028-working-tree-encoding.sh test #3 data","startedAt":"2019-03-09T14:37:01Z","lastAt":"2019-03-10T06:34:05Z","messageCount":4,"participants":["Jeffrey Walton","Torsten Bögershausen"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"371030","messageId":"CAH8yC8kSakS807d4jc_BtcUJOrcVT4No37AXSz=jePxhw-o9Dg@mail.gmail.com","threadId":"50702","inReplyTo":null,"subject":"t0028-working-tree-encoding.sh test #3 data","fromName":"Jeffrey Walton","fromEmail":"noloader@gmail.com","sentAt":"2019-03-09T14:36:34Z","receivedAt":"2019-03-09T14:37:01Z","isPatch":false,"sender":{"key":"noloader@gmail.com","avatar":null},"body":"Hi Everyone,\n\nI'm experiencing a failure in t0028-working-tree-encoding.sh. The\nfirst failure is test #3. The source states \"source (test.utf16lebom,\nconsidered UTF-16LE-BOM)\" but it looks like a UTF16-LE BOM followed by\na UTF32-LE stream.\n\nAm I misunderstanding the data presentation?\n\n$ ./t0028-working-tree-encoding.sh -v -i\n...\nok 2 - ensure UTF-8 is stored in Git\n\nexpecting success:\n        test_when_finished \"rm -f test.utf16.raw\" &&\n\n        rm test.utf16 &&\n        git checkout test.utf16 &&\n        test_cmp_bin test.utf16.raw test.utf16\n\nUpdated 1 path from the index\nsource (test.utf16lebom, considered UTF-16LE-BOM):\n|  0: ff   |  1: fe   |  2: 68 h |  3:  0   |  4:  0   |  5:  0   |\n6: 61 a |  7:  0\n|  8:  0   |  9:  0   | 10: 6c l | 11:  0   | 12:  0   | 13:  0   |\n14: 6c l | 15:  0\n| 16:  0   | 17:  0   | 18: 6f o | 19:  0   | 20:  0   | 21:  0   |\n22: 20   | 23:  0\n| 24:  0   | 25:  0   | 26: 74 t | 27:  0   | 28:  0   | 29:  0   |\n30: 68 h | 31:  0\n| 32:  0   | 33:  0   | 34: 65 e | 35:  0   | 36:  0   | 37:  0   |\n38: 72 r | 39:  0\n| 40:  0   | 41:  0   | 42: 65 e | 43:  0   | 44:  0   | 45:  0   |\n46: 21 ! | 47:  0\n| 48:  0   | 49:  0   | 50:  a   | 51:  0   | 52:  0   | 53:  0   |\n54: 63 c | 55:  0\n| 56:  0   | 57:  0   | 58: 61 a | 59:  0   | 60:  0   | 61:  0   |\n62: 6e n | 63:  0\n| 64:  0   | 65:  0   | 66: 20   | 67:  0   | 68:  0   | 69:  0   |\n70: 79 y | 71:  0\n| 72:  0   | 73:  0   | 74: 6f o | 75:  0   | 76:  0   | 77:  0   |\n78: 75 u | 79:  0\n| 80:  0   | 81:  0   | 82: 20   | 83:  0   | 84:  0   | 85:  0   |\n86: 72 r | 87:  0\n| 88:  0   | 89:  0   | 90: 65 e | 91:  0   | 92:  0   | 93:  0   |\n94: 61 a | 95:  0\n| 96:  0   | 97:  0   | 98: 64 d | 99:  0   | 100:  0   | 101:  0   |\n102: 20   | 103:  0\n| 104:  0   | 105:  0   | 106: 6d m | 107:  0   | 108:  0   | 109:  0\n | 110: 65 e | 111:  0\n| 112:  0   | 113:  0   | 114: 3f ? | 115:  0   | 116:  0   | 117:  0\n\ndestination (test.utf16lebom, considered UTF-8):\n|  0: 68 h |  1:  0   |  2: 61 a |  3:  0   |  4: 6c l |  5:  0   |\n6: 6c l |  7:  0\n|  8: 6f o |  9:  0   | 10: 20   | 11:  0   | 12: 74 t | 13:  0   |\n14: 68 h | 15:  0\n| 16: 65 e | 17:  0   | 18: 72 r | 19:  0   | 20: 65 e | 21:  0   |\n22: 21 ! | 23:  0\n| 24:  a   | 25:  0   | 26: 63 c | 27:  0   | 28: 61 a | 29:  0   |\n30: 6e n | 31:  0\n| 32: 20   | 33:  0   | 34: 79 y | 35:  0   | 36: 6f o | 37:  0   |\n38: 75 u | 39:  0\n| 40: 20   | 41:  0   | 42: 72 r | 43:  0   | 44: 65 e | 45:  0   |\n46: 61 a | 47:  0\n| 48: 64 d | 49:  0   | 50: 20   | 51:  0   | 52: 6d m | 53:  0   |\n54: 65 e | 55:  0\n| 56: 3f ? | 57:  0\n\ntest.utf16.raw test.utf16 differ: char 1, line 1\nnot ok 3 - re-encode to UTF-16 on checkout\n#\n#               test_when_finished \"rm -f test.utf16.raw\" &&\n#\n#               rm test.utf16 &&\n#               git checkout test.utf16 &&\n#               test_cmp_bin test.utf16.raw test.utf16\n#\n"},{"id":"371032","messageId":"20190309161003.55t4irdwd76asnuf@tb-raspi4","threadId":"50702","inReplyTo":"CAH8yC8kSakS807d4jc_BtcUJOrcVT4No37AXSz=jePxhw-o9Dg@mail.gmail.com","subject":"Re: t0028-working-tree-encoding.sh test #3 data","fromName":"Torsten Bögershausen","fromEmail":"tboegi@web.de","sentAt":"2019-03-09T16:10:03Z","receivedAt":"2019-03-09T16:10:07Z","isPatch":false,"sender":{"key":"tboegi@web.de","avatar":"https://avatars.githubusercontent.com/u/7138363?v=4"},"body":"On Sat, Mar 09, 2019 at 09:36:34AM -0500, Jeffrey Walton wrote:\n> Hi Everyone,\n>\n> I'm experiencing a failure in t0028-working-tree-encoding.sh. The\n> first failure is test #3. The source states \"source (test.utf16lebom,\n> considered UTF-16LE-BOM)\" but it looks like a UTF16-LE BOM followed by\n> a UTF32-LE stream.\n>\n> Am I misunderstanding the data presentation?\n\nThanks for the report.\n\nI think you understand it right.\n\nMay be you can help us: Which OS are you using ?\n\nAnd what does\necho \"hallo\" | iconv -f UTF-8 -t UTF-16 | xxd\ngive ?\n\nWe may need some more debugging, may be you can send the whole log file ?\nEven if there is are a lot of ESC-sequences...\n\n\n\n>\n> $ ./t0028-working-tree-encoding.sh -v -i\n> ...\n> ok 2 - ensure UTF-8 is stored in Git\n>\n> expecting success:\n>         test_when_finished \"rm -f test.utf16.raw\" &&\n>\n>         rm test.utf16 &&\n>         git checkout test.utf16 &&\n>         test_cmp_bin test.utf16.raw test.utf16\n>\n> Updated 1 path from the index\n> source (test.utf16lebom, considered UTF-16LE-BOM):\n> |  0: ff   |  1: fe   |  2: 68 h |  3:  0   |  4:  0   |  5:  0   |\n> 6: 61 a |  7:  0\n> |  8:  0   |  9:  0   | 10: 6c l | 11:  0   | 12:  0   | 13:  0   |\n> 14: 6c l | 15:  0\n> | 16:  0   | 17:  0   | 18: 6f o | 19:  0   | 20:  0   | 21:  0   |\n> 22: 20   | 23:  0\n> | 24:  0   | 25:  0   | 26: 74 t | 27:  0   | 28:  0   | 29:  0   |\n> 30: 68 h | 31:  0\n> | 32:  0   | 33:  0   | 34: 65 e | 35:  0   | 36:  0   | 37:  0   |\n> 38: 72 r | 39:  0\n> | 40:  0   | 41:  0   | 42: 65 e | 43:  0   | 44:  0   | 45:  0   |\n> 46: 21 ! | 47:  0\n> | 48:  0   | 49:  0   | 50:  a   | 51:  0   | 52:  0   | 53:  0   |\n> 54: 63 c | 55:  0\n> | 56:  0   | 57:  0   | 58: 61 a | 59:  0   | 60:  0   | 61:  0   |\n> 62: 6e n | 63:  0\n> | 64:  0   | 65:  0   | 66: 20   | 67:  0   | 68:  0   | 69:  0   |\n> 70: 79 y | 71:  0\n> | 72:  0   | 73:  0   | 74: 6f o | 75:  0   | 76:  0   | 77:  0   |\n> 78: 75 u | 79:  0\n> | 80:  0   | 81:  0   | 82: 20   | 83:  0   | 84:  0   | 85:  0   |\n> 86: 72 r | 87:  0\n> | 88:  0   | 89:  0   | 90: 65 e | 91:  0   | 92:  0   | 93:  0   |\n> 94: 61 a | 95:  0\n> | 96:  0   | 97:  0   | 98: 64 d | 99:  0   | 100:  0   | 101:  0   |\n> 102: 20   | 103:  0\n> | 104:  0   | 105:  0   | 106: 6d m | 107:  0   | 108:  0   | 109:  0\n>  | 110: 65 e | 111:  0\n> | 112:  0   | 113:  0   | 114: 3f ? | 115:  0   | 116:  0   | 117:  0\n>\n> destination (test.utf16lebom, considered UTF-8):\n> |  0: 68 h |  1:  0   |  2: 61 a |  3:  0   |  4: 6c l |  5:  0   |\n> 6: 6c l |  7:  0\n> |  8: 6f o |  9:  0   | 10: 20   | 11:  0   | 12: 74 t | 13:  0   |\n> 14: 68 h | 15:  0\n> | 16: 65 e | 17:  0   | 18: 72 r | 19:  0   | 20: 65 e | 21:  0   |\n> 22: 21 ! | 23:  0\n> | 24:  a   | 25:  0   | 26: 63 c | 27:  0   | 28: 61 a | 29:  0   |\n> 30: 6e n | 31:  0\n> | 32: 20   | 33:  0   | 34: 79 y | 35:  0   | 36: 6f o | 37:  0   |\n> 38: 75 u | 39:  0\n> | 40: 20   | 41:  0   | 42: 72 r | 43:  0   | 44: 65 e | 45:  0   |\n> 46: 61 a | 47:  0\n> | 48: 64 d | 49:  0   | 50: 20   | 51:  0   | 52: 6d m | 53:  0   |\n> 54: 65 e | 55:  0\n> | 56: 3f ? | 57:  0\n>\n> test.utf16.raw test.utf16 differ: char 1, line 1\n> not ok 3 - re-encode to UTF-16 on checkout\n> #\n> #               test_when_finished \"rm -f test.utf16.raw\" &&\n> #\n> #               rm test.utf16 &&\n> #               git checkout test.utf16 &&\n> #               test_cmp_bin test.utf16.raw test.utf16\n> #\n"},{"id":"371055","messageId":"CAH8yC8=01S8m8XCPoHgfX1woAEzHN7HXEn2Ncc1ceOF0SMnFaQ@mail.gmail.com","threadId":"50702","inReplyTo":"20190309161003.55t4irdwd76asnuf@tb-raspi4","subject":"Re: t0028-working-tree-encoding.sh test #3 data","fromName":"Jeffrey Walton","fromEmail":"noloader@gmail.com","sentAt":"2019-03-10T01:57:07Z","receivedAt":"2019-03-10T01:57:36Z","isPatch":false,"sender":{"key":"noloader@gmail.com","avatar":null},"body":"On Sat, Mar 9, 2019 at 11:10 AM Torsten Bögershausen <tboegi@web.de> wrote:\n>\n> On Sat, Mar 09, 2019 at 09:36:34AM -0500, Jeffrey Walton wrote:\n> >\n> > I'm experiencing a failure in t0028-working-tree-encoding.sh. The\n> > first failure is test #3. The source states \"source (test.utf16lebom,\n> > considered UTF-16LE-BOM)\" but it looks like a UTF16-LE BOM followed by\n> > a UTF32-LE stream.\n> >\n> > Am I misunderstanding the data presentation?\n>\n> Thanks for the report.\n>\n> I think you understand it right.\n>\n> May be you can help us: Which OS are you using ?\n\nFedora 29, x86_64 fully patched.\n\nHowever, I'm building Git and all of its dependencies with additional\nflags for testing. The prefix directory is /var/tmp and the lib\ndirectory is /var/tmp/lib64.\n\nRPATHS are set for everything being built, but I don't rule out those\nstupid path problems that plague Linux. In the past I have seen grep\nand awk from /bin use special builds of libraries in /var/tmp/lib64. I\nhave not figured out how to tell programs in /bin to stop using test\nlibraries in /var/tmp/lib64.\n\n> And what does\n> echo \"hallo\" | iconv -f UTF-8 -t UTF-16 | xxd\n> give ?\n\n$ PATH=/var/tmp/bin/:$PATH echo \"hallo\" | iconv -f UTF-8 -t UTF-16 | xxd\n00000000: fffe 6800 6100 6c00 6c00 6f00 0a00       ..h.a.l.l.o...\n\nAnd:\n\n$ PATH=/var/tmp/bin/:$PATH echo \"hallo\" | /usr/bin/iconv -f UTF-8 -t\nUTF-16 | xxd\n00000000: fffe 6800 6100 6c00 6c00 6f00 0a00       ..h.a.l.l.o...\n\n> We may need some more debugging, may be you can send the whole log file ?\n> Even if there is are a lot of ESC-sequences...\n\nYes, absolutely. Which file would you like?\n\n(The only thing I can find is config.log).\n\nJeff\n"},{"id":"371062","messageId":"20190310063359.ejcv47fihnnbjqp4@tb-raspi4","threadId":"50702","inReplyTo":"CAH8yC8=01S8m8XCPoHgfX1woAEzHN7HXEn2Ncc1ceOF0SMnFaQ@mail.gmail.com","subject":"Re: t0028-working-tree-encoding.sh test #3 data","fromName":"Torsten Bögershausen","fromEmail":"tboegi@web.de","sentAt":"2019-03-10T06:33:59Z","receivedAt":"2019-03-10T06:34:05Z","isPatch":false,"sender":{"key":"tboegi@web.de","avatar":"https://avatars.githubusercontent.com/u/7138363?v=4"},"body":"On Sat, Mar 09, 2019 at 08:57:07PM -0500, Jeffrey Walton wrote:\n> On Sat, Mar 9, 2019 at 11:10 AM Torsten Bögershausen <tboegi@web.de> wrote:\n> >\n> > On Sat, Mar 09, 2019 at 09:36:34AM -0500, Jeffrey Walton wrote:\n> > >\n> > > I'm experiencing a failure in t0028-working-tree-encoding.sh. The\n> > > first failure is test #3. The source states \"source (test.utf16lebom,\n> > > considered UTF-16LE-BOM)\" but it looks like a UTF16-LE BOM followed by\n> > > a UTF32-LE stream.\n> > >\n> > > Am I misunderstanding the data presentation?\n> >\n> > Thanks for the report.\n> >\n> > I think you understand it right.\n> >\n> > May be you can help us: Which OS are you using ?\n>\n> Fedora 29, x86_64 fully patched.\n>\n> However, I'm building Git and all of its dependencies with additional\n> flags for testing. The prefix directory is /var/tmp and the lib\n> directory is /var/tmp/lib64.\n>\n> RPATHS are set for everything being built, but I don't rule out those\n> stupid path problems that plague Linux. In the past I have seen grep\n> and awk from /bin use special builds of libraries in /var/tmp/lib64. I\n> have not figured out how to tell programs in /bin to stop using test\n> libraries in /var/tmp/lib64.\n>\n> > And what does\n> > echo \"hallo\" | iconv -f UTF-8 -t UTF-16 | xxd\n> > give ?\n>\n> $ PATH=/var/tmp/bin/:$PATH echo \"hallo\" | iconv -f UTF-8 -t UTF-16 | xxd\n> 00000000: fffe 6800 6100 6c00 6c00 6f00 0a00       ..h.a.l.l.o...\n>\n> And:\n>\n> $ PATH=/var/tmp/bin/:$PATH echo \"hallo\" | /usr/bin/iconv -f UTF-8 -t\n> UTF-16 | xxd\n> 00000000: fffe 6800 6100 6c00 6c00 6f00 0a00       ..h.a.l.l.o...\n>\n> > We may need some more debugging, may be you can send the whole log file ?\n> > Even if there is are a lot of ESC-sequences...\n>\n> Yes, absolutely. Which file would you like?\n>\n> (The only thing I can find is config.log).\n>\n> Jeff\n\n(Which version of Git are you using ?\nI assume that you use the latest master ?)\n\nSorry being unclear about the log file.\nThe idea is to run t0028 from the t/ directory like this:\n ./t0028-working-tree-encoding.sh -v 2>&1 | tee t28.txt\n And send the t28.txt to us.\n\n But before doing that, it may be useful to patch convert.c to remove\n the \"ANSI sequences\" and make the log file easier to read.\nIn convert.c, remove the  \"\\033[2m%2\" and \"\\033[2m%0\" stuff in trace_encoding().\n(Or use the patch I just send out).\n\nMy version looks like this (shortened, you say you see a breakage in test #3 ?\n\n\nInitialized empty Git repository in XXX/t/trash directory.t0028-working-tree-encoding/.git/\nexpecting success:\n\tgit config core.eol lf &&\n\n\ttext=\"hallo there!\\ncan you read me?\" &&\n\techo \"*.utf16 text working-tree-encoding=utf-16\" >.gitattributes &&\n\techo \"*.utf16lebom text working-tree-encoding=UTF-16LE-BOM\" >>.gitattributes &&\n\tprintf \"$text\" >test.utf8.raw &&\n\tprintf \"$text\" | write_utf16 >test.utf16.raw &&\n\tprintf \"$text\" | write_utf32 >test.utf32.raw &&\n\tprintf \"\\377\\376\"                         >test.utf16lebom.raw &&\n\tprintf \"$text\" | iconv -f UTF-8 -t UTF-32LE >>test.utf16lebom.raw &&\n\n\t# Line ending tests\n\tprintf \"one\\ntwo\\nthree\\n\" >lf.utf8.raw &&\n\tprintf \"one\\r\\ntwo\\r\\nthree\\r\\n\" >crlf.utf8.raw &&\n\n\t# BOM tests\n\tprintf \"\\0a\\0b\\0c\"                         >nobom.utf16be.raw &&\n\tprintf \"a\\0b\\0c\\0\"                         >nobom.utf16le.raw &&\n\tprintf \"\\376\\377\\0a\\0b\\0c\"                 >bebom.utf16be.raw &&\n\tprintf \"\\377\\376a\\0b\\0c\\0\"                 >lebom.utf16le.raw &&\n\tprintf \"\\0\\0\\0a\\0\\0\\0b\\0\\0\\0c\"             >nobom.utf32be.raw &&\n\tprintf \"a\\0\\0\\0b\\0\\0\\0c\\0\\0\\0\"             >nobom.utf32le.raw &&\n\tprintf \"\\0\\0\\376\\377\\0\\0\\0a\\0\\0\\0b\\0\\0\\0c\" >bebom.utf32be.raw &&\n\tprintf \"\\377\\376\\0\\0a\\0\\0\\0b\\0\\0\\0c\\0\\0\\0\" >lebom.utf32le.raw &&\n\n\t# Add only UTF-16 file, we will add the UTF-32 file later\n\tcp test.utf16.raw test.utf16 &&\n\tcp test.utf32.raw test.utf32 &&\n\tcp test.utf16lebom.raw test.utf16lebom &&\n\tgit add .gitattributes test.utf16 test.utf16lebom &&\n\tgit commit -m initial\n\nchecking prerequisite: NO_UTF16_BOM\n\nmkdir -p \"$TRASH_DIRECTORY/prereq-test-dir\" &&\n(\n\tcd \"$TRASH_DIRECTORY/prereq-test-dir\" &&\n\ttest $(printf abc | iconv -f UTF-8 -t UTF-16 | wc -c) = 6\n\n)\nprerequisite NO_UTF16_BOM not satisfied\nchecking prerequisite: NO_UTF32_BOM\n\nmkdir -p \"$TRASH_DIRECTORY/prereq-test-dir\" &&\n(\n\tcd \"$TRASH_DIRECTORY/prereq-test-dir\" &&\n\ttest $(printf abc | iconv -f UTF-8 -t UTF-32 | wc -c) = 12\n\n)\nprerequisite NO_UTF32_BOM not satisfied\nsource (test.utf16, considered utf-16):\n|  0: ff   |  1: fe   |  2: 68 h |  3:  0   |  4: 61 a |  5:  0   |  6: 6c l |  7:  0\n|  8: 6c l |  9:  0   | 10: 6f o | 11:  0   | 12: 20   | 13:  0   | 14: 74 t | 15:  0\n| 16: 68 h | 17:  0   | 18: 65 e | 19:  0   | 20: 72 r | 21:  0   | 22: 65 e | 23:  0\n| 24: 21 ! | 25:  0   | 26:  a   | 27:  0   | 28: 63 c | 29:  0   | 30: 61 a | 31:  0\n| 32: 6e n | 33:  0   | 34: 20   | 35:  0   | 36: 79 y | 37:  0   | 38: 6f o | 39:  0\n| 40: 75 u | 41:  0   | 42: 20   | 43:  0   | 44: 72 r | 45:  0   | 46: 65 e | 47:  0\n| 48: 61 a | 49:  0   | 50: 64 d | 51:  0   | 52: 20   | 53:  0   | 54: 6d m | 55:  0\n| 56: 65 e | 57:  0   | 58: 3f ? | 59:  0\n\ndestination (test.utf16, considered UTF-8):\n|  0: 68 h |  1: 61 a |  2: 6c l |  3: 6c l |  4: 6f o |  5: 20   |  6: 74 t |  7: 68 h\n|  8: 65 e |  9: 72 r | 10: 65 e | 11: 21 ! | 12:  a   | 13: 63 c | 14: 61 a | 15: 6e n\n| 16: 20   | 17: 79 y | 18: 6f o | 19: 75 u | 20: 20   | 21: 72 r | 22: 65 e | 23: 61 a\n| 24: 64 d | 25: 20   | 26: 6d m | 27: 65 e | 28: 3f ?\n\nsource (test.utf16lebom, considered UTF-16LE-BOM):\n|  0: ff   |  1: fe   |  2: 68 h |  3:  0   |  4:  0   |  5:  0   |  6: 61 a |  7:  0\n|  8:  0   |  9:  0   | 10: 6c l | 11:  0   | 12:  0   | 13:  0   | 14: 6c l | 15:  0\n| 16:  0   | 17:  0   | 18: 6f o | 19:  0   | 20:  0   | 21:  0   | 22: 20   | 23:  0\n| 24:  0   | 25:  0   | 26: 74 t | 27:  0   | 28:  0   | 29:  0   | 30: 68 h | 31:  0\n| 32:  0   | 33:  0   | 34: 65 e | 35:  0   | 36:  0   | 37:  0   | 38: 72 r | 39:  0\n| 40:  0   | 41:  0   | 42: 65 e | 43:  0   | 44:  0   | 45:  0   | 46: 21 ! | 47:  0\n| 48:  0   | 49:  0   | 50:  a   | 51:  0   | 52:  0   | 53:  0   | 54: 63 c | 55:  0\n| 56:  0   | 57:  0   | 58: 61 a | 59:  0   | 60:  0   | 61:  0   | 62: 6e n | 63:  0\n| 64:  0   | 65:  0   | 66: 20   | 67:  0   | 68:  0   | 69:  0   | 70: 79 y | 71:  0\n| 72:  0   | 73:  0   | 74: 6f o | 75:  0   | 76:  0   | 77:  0   | 78: 75 u | 79:  0\n| 80:  0   | 81:  0   | 82: 20   | 83:  0   | 84:  0   | 85:  0   | 86: 72 r | 87:  0\n| 88:  0   | 89:  0   | 90: 65 e | 91:  0   | 92:  0   | 93:  0   | 94: 61 a | 95:  0\n| 96:  0   | 97:  0   | 98: 64 d | 99:  0   | 100:  0   | 101:  0   | 102: 20   | 103:  0\n| 104:  0   | 105:  0   | 106: 6d m | 107:  0   | 108:  0   | 109:  0   | 110: 65 e | 111:  0\n| 112:  0   | 113:  0   | 114: 3f ? | 115:  0   | 116:  0   | 117:  0\n\ndestination (test.utf16lebom, considered UTF-8):\n|  0: 68 h |  1:  0   |  2: 61 a |  3:  0   |  4: 6c l |  5:  0   |  6: 6c l |  7:  0\n|  8: 6f o |  9:  0   | 10: 20   | 11:  0   | 12: 74 t | 13:  0   | 14: 68 h | 15:  0\n| 16: 65 e | 17:  0   | 18: 72 r | 19:  0   | 20: 65 e | 21:  0   | 22: 21 ! | 23:  0\n| 24:  a   | 25:  0   | 26: 63 c | 27:  0   | 28: 61 a | 29:  0   | 30: 6e n | 31:  0\n| 32: 20   | 33:  0   | 34: 79 y | 35:  0   | 36: 6f o | 37:  0   | 38: 75 u | 39:  0\n| 40: 20   | 41:  0   | 42: 72 r | 43:  0   | 44: 65 e | 45:  0   | 46: 61 a | 47:  0\n| 48: 64 d | 49:  0   | 50: 20   | 51:  0   | 52: 6d m | 53:  0   | 54: 65 e | 55:  0\n| 56: 3f ? | 57:  0\n\n[master (root-commit) 275413c] initial\n Author: A U Thor <author@example.com>\n 3 files changed, 4 insertions(+)\n create mode 100644 .gitattributes\n create mode 100644 test.utf16\n create mode 100644 test.utf16lebom\nok 1 - setup test files\n\nexpecting success:\n\ttest_when_finished \"rm -f test.utf16.git\" &&\n\n\tgit cat-file -p :test.utf16 >test.utf16.git &&\n\ttest_cmp_bin test.utf8.raw test.utf16.git\n\nok 2 - ensure UTF-8 is stored in Git\n\nexpecting success:\n\ttest_when_finished \"rm -f test.utf16.raw\" &&\n\n\trm test.utf16 &&\n\tgit checkout test.utf16 &&\n\ttest_cmp_bin test.utf16.raw test.utf16\n\nUpdated 1 path from the index\nok 3 - re-encode to UTF-16 on checkout\n[snip]\n"}]}