Re: Git-mediawiki : Encoding problems in perl

From: Steffen Daode Nurpmeso <sdaoden@googlemail.com>
Date: Jun 8, 2011, 14:37 UTC
Message-ID: <20110608143726.GA72373@sherwood.local>
In-Reply-To: <BANLkTimy85b3nu05FBjXzdnTJP0RBWdxiQ@mail.gmail.com>

@ Jérémie NIKAES <jeremie.nikaes@gmail.com> wrote (2011-06-08 15:45+0200):

Show 5 quoted lines

> But, when I look at the page on mediawiki, I see weird characters : Ã©tÃ©.
> 
> I tried text => encode_utf8('été') with no success.
> 
> Do you have any information regarding this issue ?

I'm not a Perl guru, but i ran into the very same problem when writing a disc-ripper/CDDB lookup/DB writer, and the following snippet helped me out:

    $CDDB{TITLES} = $dinf->{ttitles};
    foreach (@{$dinf->{ttitles}}) {
        s/^\s*(.*?)\s*$/$1/;
        my $save = $_;
        eval { Encode::from_to($_, 'iso-8859-1', 'utf-8'); };
        $_ = $save if $@;
        Encode::_utf8_off($_);
    }

I forget the exact circumstances, but as far as i remember you need to trigger the is-UTF-8 bit on the string object in an discouraged (acc. to manual) way to make it work the way it should. -- Ciao, Steffen sdaoden(*)(gmail.com) () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments