{"thread":{"id":"46382","subject":"Re: Git on macOS shows committed files as untracked","startedAt":"2017-07-14T04:51:28Z","lastAt":"2017-07-14T13:29:56Z","messageCount":6,"participants":["Lutz Roeder","Torsten Bögershausen","Elliot Chandler","Jeff King","Andreas Schwab"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"324489","messageId":"CANmutwAJd3qUbNmPv5WpD4zr=rt=Zt3sJ3Ackuasu=pOCRz-5g@mail.gmail.com","threadId":"46382","inReplyTo":"CANmutwCSGgLxESPmTJZXkid6P1N6HwwOTaz=7QHOsSPrrHQ4EQ@mail.gmail.com","subject":"Re: Git on macOS shows committed files as untracked","fromName":"Lutz Roeder","fromEmail":"lutz.noreply@gmail.com","sentAt":"2017-07-14T04:51:21Z","receivedAt":"2017-07-14T04:51:28Z","isPatch":false,"sender":{"key":"lutz.noreply@gmail.com","avatar":null},"body":"Using precomposeunicode still reproduces the issue:\n\nRepro steps:\n\n1. Download https://www.dropbox.com/s/0q5pbpqpckwzj7b/gitstatusrepro.zip?dl=0\n2. unzip gitstatusrepro.zip && cd gitstatusrepro\n3. git reset --hard\n4. git -c core.precomposeunicode=true status\n\nOn branch master\nUntracked files:\n (use \"git add ...\" to include in what will be committed)\n\n\"d\\314\\207\\316\\271\\314\\223\\314\\200\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\320\\243\\314\\213/\"\n\nnothing added to commit but untracked files present (use \"git add\" to track)\n\n> From: Torsten Bögershausen \n>\n> Thanks for the fast analyzes -\n> in short:\n> what does\n> git -c core.precomposeunicode=true status\n> say ?\n>\n>\n> The easiest thing may be to set\n> git config --global core.precomposeunicode true\n"},{"id":"324495","messageId":"914898a3-24da-403a-8e1c-e90b53df46a9@web.de","threadId":"46382","inReplyTo":"CANmutwCSGgLxESPmTJZXkid6P1N6HwwOTaz=7QHOsSPrrHQ4EQ@mail.gmail.com","subject":"Re: Git on macOS shows committed files as untracked","fromName":"Torsten Bögershausen","fromEmail":"tboegi@web.de","sentAt":"2017-07-14T08:41:44Z","receivedAt":"2017-07-14T08:41:03Z","isPatch":false,"sender":{"key":"tboegi@web.de","avatar":"https://avatars.githubusercontent.com/u/7138363?v=4"},"body":"\n\nOn 14/07/17 06:49, Lutz Roeder wrote:\n> Using precomposeunicode still reproduces the issue:\n> \n> Repro steps:\n> \n> 1. Download https://www.dropbox.com/s/0q5pbpqpckwzj7b/gitstatusrepro.zip?dl=0\n> 2. unzip gitstatusrepro.zip && cd gitstatusrepro\n> 3. git reset --hard\n> 4. git -c core.precomposeunicode=true status\n> \n> On branch master\n> Untracked files:\n> (use \"git add ...\" to include in what will be committed)\n\nA (short) investigation shows that this seems to be invalid unicode,\nat least from a MacOSX point of view ?\n\nUnzipping your repo shows this:\n git status -u\n deleted: \n\"\\341\\270\\213\\341\\274\\262\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\323\\262/test.txt\" \n\n\n===============\nIf I run this:\n xx=$(printf \n\"d\\314\\207\\316\\271\\314\\223\\314\\200\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\320\\243\\314\\213/\")\n\necho $xx | iconv -f UTF-8-MAC -t UTF-16 | xxd\n\niconv: (stdin):1:5: cannot convert\n0000000: feff 1e0b 1f32 2553 03b5 fbaf .....2%S....\n===============================\nSo I don't know if we can do something in Git to improve your repo.\nHow did you end up with such a directory name ?\nAnd would it be possible to rename it ?\n\n\n"},{"id":"324497","messageId":"CAHVrscBhH8U8=f44qCJEk4zQS_1B3iHiV+RnbY47f27WEqezaA@mail.gmail.com","threadId":"46382","inReplyTo":"914898a3-24da-403a-8e1c-e90b53df46a9@web.de","subject":"Re: Git on macOS shows committed files as untracked","fromName":"Elliot Chandler","fromEmail":"worldpeacehaven@gmail.com","sentAt":"2017-07-14T09:46:55Z","receivedAt":"2017-07-14T09:47:31Z","isPatch":false,"sender":{"key":"worldpeacehaven@gmail.com","avatar":null},"body":"For what it's worth, the file looks normal in Gentoo GNU/Linux (name\nappears \"ḋἲ╓εﮯ𒑏○╓Ӳ\" and it seems to work like any other directory).\n\n\nOn Fri, Jul 14, 2017 at 4:41 AM, Torsten Bögershausen wrote:\n>\n>\n> On 14/07/17 06:49, Lutz Roeder wrote:\n>>\n>> Using precomposeunicode still reproduces the issue:\n>>\n>> Repro steps:\n>>\n>> 1. Download\n>> https://www.dropbox.com/s/0q5pbpqpckwzj7b/gitstatusrepro.zip?dl=0\n>> 2. unzip gitstatusrepro.zip && cd gitstatusrepro\n>> 3. git reset --hard\n>> 4. git -c core.precomposeunicode=true status\n>>\n>> On branch master\n>> Untracked files:\n>> (use \"git add ...\" to include in what will be committed)\n>\n>\n> A (short) investigation shows that this seems to be invalid unicode,\n> at least from a MacOSX point of view ?\n>\n> Unzipping your repo shows this:\n> git status -u\n> deleted:\n> \"\\341\\270\\213\\341\\274\\262\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\323\\262/test.txt\"\n>\n> ===============\n> If I run this:\n> xx=$(printf\n> \"d\\314\\207\\316\\271\\314\\223\\314\\200\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\320\\243\\314\\213/\")\n>\n> echo $xx | iconv -f UTF-8-MAC -t UTF-16 | xxd\n>\n> iconv: (stdin):1:5: cannot convert\n> 0000000: feff 1e0b 1f32 2553 03b5 fbaf .....2%S....\n> ===============================\n> So I don't know if we can do something in Git to improve your repo.\n> How did you end up with such a directory name ?\n> And would it be possible to rename it ?\n>\n>\n"},{"id":"324500","messageId":"8b5fc22c-4d65-d34a-a84c-c913f454c771@web.de","threadId":"46382","inReplyTo":"CAHVrscDg8bc-CYm6dSJFgdPSv1vJ0=AC0s3y26CHctKkYAvJyA@mail.gmail.com","subject":"Re: Git on macOS shows committed files as untracked","fromName":"Torsten Bögershausen","fromEmail":"tboegi@web.de","sentAt":"2017-07-14T12:35:52Z","receivedAt":"2017-07-14T12:35:13Z","isPatch":false,"sender":{"key":"tboegi@web.de","avatar":"https://avatars.githubusercontent.com/u/7138363?v=4"},"body":"\n(Please no top-posting)\nOn 14/07/17 11:45, Elliot Chandler wrote:\n> For what it's worth, the file looks normal in Gentoo GNU/Linux (name appears \n> \"ḋἲ╓εﮯ𒑏○╓Ӳ\" and it seems to work like any other directory).\n> \nThanks for testing -\nNormal and Normal ;-)\nFor me the 6th code point does look strange\nThe \"box\" with 04142F:\nCode point 4142F is unassigned and is outside any currently defined block range.\n\nSo this is not valid Unicode, so we have a problem here under MacOS -\nnot much Git can do about it.\n\n\n\n> On Fri, Jul 14, 2017 at 4:41 AM, Torsten Bögershausen > wrote:\n> \n> \n> \n> On 14/07/17 06:49, Lutz Roeder wrote:\n> \n> Using precomposeunicode still reproduces the issue:\n> \n> Repro steps:\n> \n> 1. Download\n> https://www.dropbox.com/s/0q5pbpqpckwzj7b/gitstatusrepro.zip?dl=0\n> \n> 2. unzip gitstatusrepro.zip && cd gitstatusrepro\n> 3. git reset --hard\n> 4. git -c core.precomposeunicode=true status\n> \n> On branch master\n> Untracked files:\n> (use \"git add ...\" to include in what will be committed)\n> \n> \n> A (short) investigation shows that this seems to be invalid unicode,\n> at least from a MacOSX point of view ?\n> \n> Unzipping your repo shows this:\n> git status -u\n> deleted:\n> \"\\341\\270\\213\\341\\274\\262\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\323\\262/test.txt\"\n> \n> \n> ===============\n> If I run this:\n> xx=$(printf\n> \"d\\314\\207\\316\\271\\314\\223\\314\\200\\342\\225\\223\\316\\265\\357\\256\\257\\360\\222\\221\\217\\342\\227\\213\\342\\225\\223\\320\\243\\314\\213/\")\n> \n> echo $xx | iconv -f UTF-8-MAC -t UTF-16 | xxd\n> \n> iconv: (stdin):1:5: cannot convert\n> 0000000: feff 1e0b 1f32 2553 03b5 fbaf .....2%S....\n> ===============================\n> So I don't know if we can do something in Git to improve your repo.\n> How did you end up with such a directory name ?\n> And would it be possible to rename it ?\n> \n> \n> \n"},{"id":"324503","messageId":"20170714132846.dww7y5ae4fexejnc@sigill.intra.peff.net","threadId":"46382","inReplyTo":"8b5fc22c-4d65-d34a-a84c-c913f454c771@web.de","subject":"Re: Git on macOS shows committed files as untracked","fromName":"Jeff King","fromEmail":"peff@peff.net","sentAt":"2017-07-14T13:28:47Z","receivedAt":"2017-07-14T13:28:53Z","isPatch":false,"sender":{"key":"peff@peff.net","avatar":"https://avatars.githubusercontent.com/u/45925?v=4"},"body":"On Fri, Jul 14, 2017 at 02:35:52PM +0200, Torsten Bögershausen wrote:\n\n> (Please no top-posting)\n> On 14/07/17 11:45, Elliot Chandler wrote:\n> > For what it's worth, the file looks normal in Gentoo GNU/Linux (name\n> > appears \"ḋἲ╓εﮯ𒑏○╓Ӳ\" and it seems to work like any other directory).\n> > \n> Thanks for testing -\n> Normal and Normal ;-)\n> For me the 6th code point does look strange\n> The \"box\" with 04142F:\n> Code point 4142F is unassigned and is outside any currently defined block range.\n\nAre you sure? I get u+1244f. I don't have a glyph for it in my font, but\nat least it's a real unicode codepoint (cuneiform 1).\n\n> So this is not valid Unicode, so we have a problem here under MacOS -\n> not much Git can do about it.\n\nI do still suspect this is the root of the problem. There's something\nabout the string that HFS+ doesn't want to store, and there's nothing we\ncan do to fix that.\n\n-Peff\n"},{"id":"324504","messageId":"87vamvf8ok.fsf@linux-m68k.org","threadId":"46382","inReplyTo":"8b5fc22c-4d65-d34a-a84c-c913f454c771@web.de","subject":"Re: Git on macOS shows committed files as untracked","fromName":"Andreas Schwab","fromEmail":"schwab@linux-m68k.org","sentAt":"2017-07-14T13:29:47Z","receivedAt":"2017-07-14T13:29:56Z","isPatch":false,"sender":{"key":"schwab@linux-m68k.org","avatar":"https://avatars.githubusercontent.com/u/2175493?v=4"},"body":"On Jul 14 2017, Torsten Bögershausen wrote:\n\n> (Please no top-posting)\n> On 14/07/17 11:45, Elliot Chandler wrote:\n>> For what it's worth, the file looks normal in Gentoo GNU/Linux (name\n>> appears \"ḋἲ╓εﮯ𒑏○╓Ӳ\" and it seems to work like any other directory).\n>>\n> Thanks for testing -\n> Normal and Normal ;-)\n> For me the 6th code point does look strange\n> The \"box\" with 04142F:\n\nThis is actually 1244f (CUNEIFORM NUMERIC SIGN ONE BAN2).\n\nAndreas.\n\n-- \nAndreas Schwab, schwab@linux-m68k.org\nGPG Key fingerprint = 58CA 54C7 6D53 942B 1756 01D3 44D5 214B 8276 4ED5\n\"And now for something completely different.\"\n"}]}