git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Git-mediawiki : Encoding problems in perl

From
JNJérémie NIKAES <jeremie.nikaes@gmail.com>
Date
Jun 8, 2011, 22:36 UTC
Message-ID
<BANLkTikTDPmvj4oepiJdFj9EpSTNpS_Prg@mail.gmail.com>
In-Reply-To
<20110608215130.GA13021@sigill.intra.peff.net>
2011/6/8 Jeff King <peff@peff.net>:
Show 5 quoted lines
>
> But if you are parsing "diff", then yes, filenames with high-bit
> characters (or special characters like tab or double-quote) may be
> quoted C-style, and you should be unquoting them. Or, as Matthieu
> suggested, use "-z" to get a NUL-terminated, non-quoted version.

Yes, we are parsing "diff". The -z helped a lot with non-iso characters. Everything seems to be working fine now without using uri_escape. The problem is, as Matthieu said, different file systems may handle these characters in file names differently, so in the long run it could be better to use uri_escape / uri_unescape.

The problem I run into now is that we are using use encoding 'utf-8' as Jakub suggested. Using this mode, when you uri_escape and uri_unescape a string, you don't get the original string. I must be missing something but my head is kind of fuzzy with all the different existing methods to encode things in utf8 and it is getting pretty late.

Thanks a lot to everyone who helped today, a RFC patch should follow tomorrow.
-- 
Jérémie Nikaes
Previous: Jeff KingNext: Jakub Narebski
Message 18 of 20 in “Git-mediawiki : Encoding problems in perl”
  1. Jérémie NIKAESJun 8, 2011
  2. Steffen Daode NurpmesoJun 8, 2011
  3. Jeff KingJun 8, 2011
  4. Matthieu MoyJun 8, 2011
  5. Jeff KingJun 8, 2011
  6. Jérémie NIKAESJun 8, 2011
  7. Matthieu MoyJun 8, 2011
  8. Jérémie NIKAESJun 8, 2011
  9. Jeff KingJun 8, 2011
  10. Jérémie NIKAESJun 8, 2011
  11. Matthieu MoyJun 8, 2011
  12. Jérémie NIKAESJun 8, 2011
  13. Jakub NarebskiJun 8, 2011
  14. Matthieu MoyJun 8, 2011
  15. Jérémie NIKAESJun 8, 2011
  16. Matthieu MoyJun 8, 2011
  17. Jeff KingJun 8, 2011
  18. Jérémie NIKAESJun 8, 2011
  19. Jakub NarebskiJun 8, 2011
  20. Jérémie NIKAESJun 8, 2011

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.