git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: non-ascii filenames issue

From
Ddemerphq <demerphq@gmail.com>
Date
Apr 7, 2009, 08:26 UTC
Message-ID
<9b18b3110904070126i354fc100l69b6ce3c9cd19d49@mail.gmail.com>
In-Reply-To
<alpine.DEB.2.00.0904060823400.21376@ds9.cixit.se>
2009/4/6 Peter Krefting <peter@softwolves.pp.se>:
Show 12 quoted lines
> John Tapsell:
>
>> Unfortunately not, because for some absolutely crazy reason, there is no
>> way at all to tell what encoding the string is in.  It never occured to
>> anyone that it might actually be useful to be able to read the filename in
>> an unambiguous way.
>
> It comes from the Unix tradition, unfortunately, that file names are just a
> stream of bytes, instead of a stream of characters mapped to a byte
> sequence. The "stream of bytes" think worked back when everyone used ASCII,
> but as soon as other character encodings were used (i.e back in the 1970s or
> so), that assumption broke.

Those interested in this subject may find the following document on the creation of utf8 interesting.

http://www.cl.cam.ac.uk/~mgk25/ucs/utf-8-history.txt

cheers, Yves

-- 
perl -Mre=debug -e "/just|another|perl|hacker/"
Previous: Dmitry Potapov
Message 11 of 11 in “non-ascii filenames issue”
  1. Gregory PetrosyanApr 5, 2009
  2. Teemu LikonenApr 5, 2009
  3. Gregory PetrosyanApr 5, 2009
  4. John TapsellApr 5, 2009
  5. Jay SoffianApr 5, 2009
  6. Junio C HamanoApr 5, 2009
  7. Jay SoffianApr 5, 2009
  8. Peter KreftingApr 6, 2009
  9. Johannes SchindelinApr 6, 2009
  10. Dmitry PotapovApr 6, 2009
  11. demerphqApr 7, 2009

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.