Re: UTF-8 question

From: Markus Scherer (markus.scherer@jtcsv.com)
Date: Tue Feb 25 2003 - 11:28:35 EST

Next message: Markus Scherer: "Re: Finding string with special characters"

Previous message: John H. Jenkins: "Re: Unihan DB / kKarlgren / kFrequency."
In reply to: Doug Ewell: "Re: UTF-8 question"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] [ attachment ]
Mail actions: [ respond to this message ] [ mail a new topic ]

A UTF-x converter must handle non-characters like U+FFFE, U+FDD0, etc.

Unicode 3.0 chapter 3.8 Transformations clause D29 defines this, and the text there and below spells
out that non-characters and the like must be converted as well. The change since 3.0 only affects
single-surrogate code points. Non-characters should not be exchanged across system boundaries, but
the converter does not necessarily define such a boundary.

markus

-- 
Opinions expressed here may not reflect my company's positions unless otherwise noted.

Next message: Markus Scherer: "Re: Finding string with special characters"
Previous message: John H. Jenkins: "Re: Unihan DB / kKarlgren / kFrequency."
In reply to: Doug Ewell: "Re: UTF-8 question"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] [ attachment ]
Mail actions: [ respond to this message ] [ mail a new topic ]

This archive was generated by hypermail 2.1.5 : Tue Feb 25 2003 - 12:11:23 EST