Page 1 of 1
Unicode Problems With Japanese Text
Posted: Thu Jan 20, 2005 10:39 pm
by delphian
When i try to use Suggest Translation or Auto Translate i get a Question mark appear in front of my unicode japanese text
ie i am trying to translate the word / phrase " Booking Date " , which i have 予約作成日 in the dictionary and it returns ?約作成日
i believe the point where the problem occurs is in the following line of code.
S := FIntf.GetTranslation(BaseLang, ActiveLang, Cells[BaseCol, J]);
in siTransEditor , Function sbDictAutoClick
Posted: Fri Jan 21, 2005 7:23 am
by isiticov
Does the same apply when you use Find Translation button or only for Suggest and Auto-Translate?
Japanese Text ( Unicode )
Posted: Sun Jan 23, 2005 10:40 pm
by delphian
Yes it gives the same error when i use find translation. it only happens with japanese text , we have korean as well and its perfect.
Kind Regards
Dephian
Posted: Mon Jan 24, 2005 7:52 am
by isiticov
Strange, could you please send us the DIC file use or at least problematic part of it? Then we will try to debug and test here in order to find the problem. Thanks.
Unicode Problems With Japanese Text
Posted: Tue Jan 25, 2005 6:15 am
by delphian
I've found the reason why the question marks appear , it seems our importing program was placing the unicode header of $FFFE on each unicode word in the XML import.
We have removed it and it now works perfectly.
maybe on your XML import you should scan the text and if the first wide char = $FEFF then remove it.
Kind Regards
Delphian
Posted: Tue Jan 25, 2005 6:35 am
by isiticov
Actually, only first two bytes of the file must be #FEFF for Unicovde files.
Posted: Tue Jan 25, 2005 7:57 am
by delphian
Yes the its included in the first two bytes of the XML file ... not on each string
Delphian
we tested it at the office and it now imports properly