{"thread":{"id":"9771","subject":"HFS+ Unicode weirdness","startedAt":"2007-09-04T12:30:51Z","lastAt":"2007-09-04T13:59:35Z","messageCount":4,"participants":["Wincent Colaiuta","Johannes Schindelin","David Symonds"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"52428","messageId":"052099D2-F79B-4063-82D3-BFB5D0102A55@wincent.com","threadId":"9771","inReplyTo":null,"subject":"HFS+ Unicode weirdness","fromName":"Wincent Colaiuta","fromEmail":"win@wincent.com","sentAt":"2007-09-04T12:30:51Z","receivedAt":"2007-09-04T12:30:51Z","isPatch":false,"sender":{"key":"greg@hurrell.net","avatar":"https://avatars.githubusercontent.com/u/7074?v=4"},"body":"On a brand new clone of git.git the file \"gitweb/test/Märchen\" is \nprovoking some weird behaviour running on Mac OS X and the toy HFS+ \nfilesystem. Note how the unmodified checkout of the file is shown as \n\"untracked\" by \"git st\", but on deleting the file it's shown as \n\"deleted\". If I build a copy of Git based on the clean working tree \nthen the resulting build has a version number of \"1.5.x-dirty\".\n\nAny suggestions on where to start investigating the cause of this? \nAbout the only lead I have is that if I create a file with that name \nby typing it's name it's encoded as \"Ma\\314\\210rchen\", but the file \nin the git.git repo is encoded as \"M\\303\\244rchen\".\n\nCheers,\nWincent\n\n$ git clone git://git.kernel.org/pub/scm/git/git.git\nInitialized empty Git repository in /tmp/git/.git/\nremote: Generating pack...\nremote: Counting objects: 12259\nDone counting 58277 objects.\nremote: Deltifying 58277 objects...\nremote: 100% (58277/58277) done\nIndexing 58277 objects...\nremote: Total 58277 (delta 40699), reused 58034 (delta 40521)\n 100% (58277/58277) done\nResolving 40699 deltas...\n 100% (40699/40699) done\n$ cd git\n/tmp/git\n$ git st\n# On branch master\n# Untracked files:\n# (use \"git add ...\" to include in what will be committed)\n#\n# gitweb/test/Märchen\nnothing added to commit but untracked files present (use \"git add\" to \ntrack)\n$ ls -laF gitweb/test\ntotal 24\ndrwxr-xr-x 5 wincent wheel 170 Sep 4 14:18 ./\ndrwxr-xr-x 9 wincent wheel 306 Sep 4 14:18 ../\n-rw-r--r-- 1 wincent wheel 17 Sep 4 14:18 Ma??rchen\n-rw-r--r-- 1 wincent wheel 31 Sep 4 14:18 file with spaces\n-rw-r--r-- 1 wincent wheel 37 Sep 4 14:18 file+plus+sign\n$ rm gitweb/test/Märchen\n$ git st\n# On branch master\n# Changed but not updated:\n# (use \"git add/rm ...\" to update what will be committed)\n#\n# deleted: gitweb/test/Märchen\n#\nno changes added to commit (use \"git add\" and/or \"git commit -a\")"},{"id":"52432","messageId":"Pine.LNX.4.64.0709041359310.28586@racer.site","threadId":"9771","inReplyTo":"052099D2-F79B-4063-82D3-BFB5D0102A55@wincent.com","subject":"Re: HFS+ Unicode weirdness","fromName":"Johannes Schindelin","fromEmail":"johannes.schindelin@gmx.de","sentAt":"2007-09-04T13:00:50Z","receivedAt":"2007-09-04T13:00:50Z","isPatch":false,"sender":{"key":"johannes.schindelin@gmx.de","avatar":"https://avatars.githubusercontent.com/u/127790?v=4"},"body":"Hi,\n\nOn Tue, 4 Sep 2007, Wincent Colaiuta wrote:\n\n> On a brand new clone of git.git the file \"gitweb/test/M?rchen\" is provoking\n> some weird behaviour running on Mac OS X and the toy HFS+ filesystem.\n\nPlease search the mail archives. This has come up quite a couple of \ntimes.\n\nCiao,\nDscho\n"},{"id":"52434","messageId":"ee77f5c20709040607u163d1336k46c83cfb9e37bfee@mail.gmail.com","threadId":"9771","inReplyTo":"052099D2-F79B-4063-82D3-BFB5D0102A55@wincent.com","subject":"Re: HFS+ Unicode weirdness","fromName":"David Symonds","fromEmail":"dsymonds@gmail.com","sentAt":"2007-09-04T13:07:45Z","receivedAt":"2007-09-04T13:07:45Z","isPatch":false,"sender":{"key":"dsymonds@gmail.com","avatar":"https://gravatar.com/avatar/b22f5051cbfc11836e36cf7a690e6cde4e225d835e13295ff98d15c7a9ee3c0f?d=mp&s=160"},"body":"On 04/09/07, Wincent Colaiuta wrote:\n> On a brand new clone of git.git the file \"gitweb/test/Märchen\" is\n> provoking some weird behaviour running on Mac OS X and the toy HFS+\n> filesystem. Note how the unmodified checkout of the file is shown as\n> \"untracked\" by \"git st\", but on deleting the file it's shown as\n> \"deleted\". If I build a copy of Git based on the clean working tree\n> then the resulting build has a version number of \"1.5.x-dirty\".\n>\n> Any suggestions on where to start investigating the cause of this?\n> About the only lead I have is that if I create a file with that name\n> by typing it's name it's encoded as \"Ma\\314\\210rchen\", but the file\n> in the git.git repo is encoded as \"M\\303\\244rchen\".\n\nIt's because OS X is using composite Unicode encoding (storing \"ä\" as\n\"a\" + umlaut). Git doesn't canonicalise things, since OS X does its\njiggery-pokery of that kind of stuff in CoreFramework, which I believe\nGit doesn't use.\n\n\nDave.\n"},{"id":"52441","messageId":"040DB556-44BC-47AC-9085-2F1E9A68E9D8@wincent.com","threadId":"9771","inReplyTo":"Pine.LNX.4.64.0709041359310.28586@racer.site","subject":"Re: HFS+ Unicode weirdness","fromName":"Wincent Colaiuta","fromEmail":"win@wincent.com","sentAt":"2007-09-04T13:59:35Z","receivedAt":"2007-09-04T13:59:35Z","isPatch":false,"sender":{"key":"greg@hurrell.net","avatar":"https://avatars.githubusercontent.com/u/7074?v=4"},"body":"El 4/9/2007, a las 15:00, Johannes Schindelin escribió:\n\n> Hi,\n>\n> On Tue, 4 Sep 2007, Wincent Colaiuta wrote:\n>\n>> On a brand new clone of git.git the file \"gitweb/test/M?rchen\" is \n>> provoking\n>> some weird behaviour running on Mac OS X and the toy HFS+ filesystem.\n>\n> Please search the mail archives. This has come up quite a couple of\n> times.\n\nFinally found it: for the record this thread seems to be relevant:\n\n\n\nFor what it's worth Subversion has exactly the same kind of problem \nwhen only some developers in a team work on HFS. For example:\n\n\n\n\nHopefully the wait for Apple to release a non-broken filesystem won't \nbe too long, ZFS being the most likely candidate at this stage.\n\nCheers,\nWincent\n"}]}