Ian Turner | 26 Feb 2012 23:47

Blackberry/Funambol: Character encoding woes

Hello list,

Just set up SyncML support with Funambol to Blackberry. Works very well!  
Thanks for your efforts in creating such a wonderful software project. I am 
encountering two problems with the SyncML support in Horde; this e-mail 
describes the second such problem.

It does not appear that character encodings are respected during the sync. I'm 
not sure if this is a blackberry problem, funambol problem, Apache problem, 
PHP problem, or Horde problem, but I can't find any FAQs about it, so I thought 
you, dear list, might know.

Example:
New memo on blackberry containing non-ASCII string "Ûñíçòðë Té§t™".
This string encoded as UTF-8:
0000000: c39b c3b1 c3ad c3a7 c3b2 c3b0 c3ab 2054  .............. T
0000010: c3a9 c2a7 74e2 84a2                     ....t...
This string encoded as ISO-8859-1 (note that '™' is not available in 
iso-8859-1)
0000000: dbf1 ede7 f2f0 eb20 54e9 a774            ....... T..t
This string encoded as XML/HTML character entities:
Ûñíçòðë Té§t™

When I create a memo containing this string on blackberry, Horde appears to 
attempt to commit this string to the database, a mix of HTML character 
entities and iso-8859-1. As this string is not valid UTF-8 (which is the 
database locale), it is rejected by the (postgres) database with the error 
"invalid byte sequence for encoding 'UTF8': 0xdbf1"
0000000: dbf1 ede7 f2f0 eb20 54e9 a774 2623 3834  ....... T..t&#84
0000010: 3832 3b0a                                82;.
(Continue reading)

Jan Schneider | 28 Feb 2012 13:17
Favicon
Gravatar

Re: Blackberry/Funambol: Character encoding woes


Zitat von Ian Turner <vectro <at> vectro.org>:

> Hello list,
>
> Just set up SyncML support with Funambol to Blackberry. Works very well!
> Thanks for your efforts in creating such a wonderful software project. I am
> encountering two problems with the SyncML support in Horde; this e-mail
> describes the second such problem.
>
> It does not appear that character encodings are respected during the  
> sync. I'm
> not sure if this is a blackberry problem, funambol problem, Apache problem,
> PHP problem, or Horde problem, but I can't find any FAQs about it,  
> so I thought
> you, dear list, might know.
>
> Example:
> New memo on blackberry containing non-ASCII string "Ûñíçòðë Té§t™".
> This string encoded as UTF-8:
> 0000000: c39b c3b1 c3ad c3a7 c3b2 c3b0 c3ab 2054  .............. T
> 0000010: c3a9 c2a7 74e2 84a2                     ....t...
> This string encoded as ISO-8859-1 (note that '™' is not available in
> iso-8859-1)
> 0000000: dbf1 ede7 f2f0 eb20 54e9 a774            ....... T..t
> This string encoded as XML/HTML character entities:
> &#219;&#241;&#237;&#231;&#242;&#240;&#235; T&#233;&#167;t&#8482;
>
> When I create a memo containing this string on blackberry, Horde appears to
> attempt to commit this string to the database, a mix of HTML character
(Continue reading)


Gmane