stefano franchi | 3 Jan 2011 22:24
Picon
Gravatar

Problems with utf8 files

I am working on a book project typeset with LuaTeX (to be more
precise, lualatex). I need to change the sort order of the various
accented letters, and make them behave as if they were unaccented
(i.e., as in the Duden-order in German). My project  is in
English/american and the tex input files are all unicode, inclusing
the \index entries (no Latex workarounds like \"o etcetera). I  wrote
a small xindy style file with my sort rules, such as:

(sort-rule "ö" "o")
(sort-rule "ü" "u")

etc.,

plus the standard modules (the whole file is appended below).

But here is my problem:

1. If I call xindy with the english language module:

xindy -L english -M mymodule.xdy myfile.idx

then the sort rules are ignored. They are obeyed only if I change  the
\index commands to contain Latex-like accents instead of unicode
accented letters. However, this is not practical, since I have
hundreds of entries contained across several files. It seems as if
xindy is not recognizing the input file as utf8.

2. If, on the contrary, I call xindy without a language module, as in

xindy mymodule.xdy myfile.idx
(Continue reading)

Zdenek Wagner | 3 Jan 2011 23:30
Picon

Re: Problems with utf8 files

2011/1/3 stefano franchi <stefano.franchi <at> gmail.com>:
> I am working on a book project typeset with LuaTeX (to be more
> precise, lualatex). I need to change the sort order of the various
> accented letters, and make them behave as if they were unaccented
> (i.e., as in the Duden-order in German). My project  is in
> English/american and the tex input files are all unicode, inclusing
> the \index entries (no Latex workarounds like \"o etcetera). I  wrote
> a small xindy style file with my sort rules, such as:
>
> (sort-rule "ö" "o")
> (sort-rule "ü" "u")
>
> etc.,
>
> plus the standard modules (the whole file is appended below).
>
> But here is my problem:
>
> 1. If I call xindy with the english language module:
>
> xindy -L english -M mymodule.xdy myfile.idx
>
> then the sort rules are ignored. They are obeyed only if I change  the
> \index commands to contain Latex-like accents instead of unicode
> accented letters. However, this is not practical, since I have
> hundreds of entries contained across several files. It seems as if
> xindy is not recognizing the input file as utf8.
>
Have you tried xindy -L general myfile.idx ? I think it's exactly what you need.

(Continue reading)

Joachim Schrod | 3 Jan 2011 23:41
Picon
Favicon

Re: Problems with utf8 files

Zdenek Wagner writes:
> 2011/1/3 stefano franchi <stefano.franchi <at> gmail.com>:
> > I am working on a book project typeset with LuaTeX (to be more
> > precise, lualatex). I need to change the sort order of the various
> > accented letters, and make them behave as if they were unaccented
> > (i.e., as in the Duden-order in German). My project  is in
> > English/american and the tex input files are all unicode, inclusing
> > the \index entries (no Latex workarounds like \"o etcetera). I  wrote
> > a small xindy style file with my sort rules, such as:
> >
> > (sort-rule "ö" "o")
> > (sort-rule "ü" "u")
> >
> > etc.,
> >
> > plus the standard modules (the whole file is appended below).
> >
> > But here is my problem:
> >
> > 1. If I call xindy with the english language module:
> >
> > xindy -L english -M mymodule.xdy myfile.idx
> >
> > then the sort rules are ignored. They are obeyed only if I change  the
> > \index commands to contain Latex-like accents instead of unicode
> > accented letters. However, this is not practical, since I have
> > hundreds of entries contained across several files. It seems as if
> > xindy is not recognizing the input file as utf8.
> >
> Have you tried xindy -L general myfile.idx ? I think it's exactly
(Continue reading)

stefano franchi | 4 Jan 2011 00:14
Picon
Gravatar

Re: Problems with utf8 files

On Mon, Jan 3, 2011 at 4:41 PM, Joachim Schrod <jschrod <at> acm.org> wrote:
> Zdenek Wagner writes:
>> 2011/1/3 stefano franchi <stefano.franchi <at> gmail.com>:
>> > I am working on a book project typeset with LuaTeX (to be more
>> > precise, lualatex). I need to change the sort order of the various
>> > accented letters, and make them behave as if they were unaccented
>> > (i.e., as in the Duden-order in German). My project  is in
>> > English/american and the tex input files are all unicode, inclusing
>> > the \index entries (no Latex workarounds like \"o etcetera). I  wrote
>> > a small xindy style file with my sort rules, such as:
>> >
>> > (sort-rule "ö" "o")
>> > (sort-rule "ü" "u")
>> >
>> > etc.,
>> >
>> > plus the standard modules (the whole file is appended below).
>> >
>> > But here is my problem:
>> >
>> > 1. If I call xindy with the english language module:
>> >
>> > xindy -L english -M mymodule.xdy myfile.idx
>> >
>> > then the sort rules are ignored. They are obeyed only if I change  the
>> > \index commands to contain Latex-like accents instead of unicode
>> > accented letters. However, this is not practical, since I have
>> > hundreds of entries contained across several files. It seems as if
>> > xindy is not recognizing the input file as utf8.
>> >
(Continue reading)


Gmane