The Unicode Consortium Discussion Forum

The Unicode Consortium Discussion Forum

 Forum Home  Unicode Home Page Code Charts Technical Reports FAQ Pages 
 
It is currently Thu Jul 31, 2014 2:24 am

All times are UTC - 6 hours [ DST ]




Post new topic Reply to topic  [ 1 post ] 
Author Message
 Post subject: Corrigendum #9 clarifies noncharacter usage in Unicode
PostPosted: Wed Feb 20, 2013 3:49 pm 
Offline
Site Admin

Joined: Mon Nov 30, 2009 5:16 pm
Posts: 134
Location: root@unicode.org
There has been confusion about whether noncharacters were permitted in Unicode text. The new Corrigendum #9: Clarification About Noncharacters http://www.unicode.org/versions/corrigendum9.htmlmakes it clear that noncharacters are permissible even in open interchange, although their intended semantics may not beinterpretable in such contexts. ​The UTF-8, UTF-16, UTF-32 & BOM FAQ http://www.unicode.org/faq/utf_bom.html has also been updated for clarity​, and other informative text about noncharacters will be revised over time​, including the Core Specification.

Background. There are 66 noncharacters permanently reserved for internal use, typically used for some sort of control function or sentinel value. They should be supported by APIs, components, and applications that handle (i.e., either process or pass through) all Unicode strings, such as a text editor or string class. Where an application does make internal use of a noncharacter, it should take some measures to sanitize input text from unknown sources. The best practice is to replace that particular noncharacter on input by U+FFFD. (The noncharacter should not be simply deleted, since that has security problems. For more information, see Section 3.5 Deletion of Code Points in UTR #36, Unicode Security Guidelines.) http://www.unicode.org/reports/tr36/#Deletion_of_Noncharacters

http://unicode-inc.blogspot.com/2013/02 ... acter.html


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 1 post ] 

All times are UTC - 6 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 2 guests


Quick-mod tools:
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
Template made by DEVPPL.com