[Unicode]  Technical Reports
 

Proposed Draft Unicode Technical Report #50

Unicode Properties for Horizontal and Vertical Text Layout

Editor Koji Ishii (koji.a.ishii@mail.rakuten.com)
Date 2012-10-14
This Version http://www.unicode.org/reports/tr50/tr50-7.html
Previous Version http://www.unicode.org/reports/tr50/tr50-6.html
Latest Version http://www.unicode.org/reports/tr50/
Latest Proposed Update http://www.unicode.org/reports/tr50/proposed.html
Revision 7

Summary

The Unicode code charts generally show characters oriented for horizontal presentationin the orientation in which they appear in horizontal lines. However, some of the glyphs are actually oriented for vertical presentation. A few characters change shape when the text is rotated from horizontal to vertical. there are a few exceptions, mostly for characters or scripts which are normally written in vertical lines. This report describes a property that documents that situation.

When text is presented in vertical lines, there are various conventions for the orientation of the characters with respect to the line. In most cases, characters are oriented in an upright manner similar to their presentation in the Unicode code charts. In a few cases, when presented in vertical lines, the text will appear rotated or transformed in various ways. For example, in East Asia, Han ideographs, Kana characters, and Latin letters of acronyms are upright, while words and sentences in the Latin script are typically sideways. In many parts of the world, most characters are upright. In East Asia, Kanji and Kana characters are upright, Latin letters of acronyms are upright, while words and sentences in the Latin script are typically sideways. This report describes atwo Unicode character propertyies which can serve as a stable default orientation of characters for reliable document interchange. be used to determine a default orientation of characters in those two scenarios.

Status

This is a draft document which may be updated, replaced, or superseded by other documents at any time. Publication does not imply endorsement by the Unicode Consortium. This is not a stable document; it is inappropriate to cite this document as other than a work in progress.

A Unicode Technical Report (UTR) contains informative material. Conformance to the Unicode Standard does not imply conformance to any UTR. Other specifications, however, are free to make normative references to a UTR.

Please submit corrigenda and other comments with the online reporting form [Feedback]. Related information that is useful in understanding this document is found in References. For the latest version of the Unicode Standard see [Unicode]. For a list of current Unicode Technical Reports see [Reports]. For more information about versions of the Unicode Standard, see [Versions].

Contents


1 Editorial Warnings

The draft is currently structured around two properties, with values in the set V={R, U, T}. This is entirely equivalent to a single property with values in the set VxV. Going one step further, we can also give names to the values in VxV and use those names as the property values. Those are syntactic details which are easy to change as this draft progresses.

Another change that can be introduced is to have a level of indirection between the property values and the actual classes, and to bridge that indirection either via a simple mapping, or via rules (e.g. in the style of linebreak) or by some other machinery.

The motivation for the current choice is mostly to make the resulting orientation as clear as possible, and to delay the introduction of more complex machinery until a rationale is provided for doing so.

2 Overview and ScopeIntroduction

The Unicode code charts generally show characters in the same orientation as in horizontal lines. However, there are a few exceptions, mostly for characters or scripts which are normally written in vertical lines; in those cases, the code charts show the characters in the same orientation as in vertical lines. Furthermore, those vertical characters and scripts are often rotated when displayed in horizontal lines; figure 1 shows an example of Mongolian text in horizontal lines, where the Mongolian characters are rotated 90 degree counter-clockwise with respect to the code charts. The property Horizontal Orientation documents that situation.

Figure 1. Mongolian text on horizontal lines

When text is displayed in vertical lines, there are various conventions for the orientation of the characters with respect to the line. In East Asia, Han ideographs and Kana characters are upright, that is appear with the same orientation as in the code charts, Latin letters of acronyms are upright, while words and sentences in the Latin script are typically sideways, as can be seen in figure 2.

Figure 2. Japanese vertical text

However, characters are laid out in different orientations in different scripts, in different styles, or sometimes by the context. The time period may also change the desired orientations. In many parts of the world, most characters are upright, that is appear with the same orientation as in the code charts, as can be seen in figure 3.

Figure 3. Western vertical text

In East Asia, Kanji and Kana characters are upright, Latin letters of acronyms are upright, while words and sentences in the Latin script are typically sideways, as can be seen in figure 2. The property Mixed Vertical Orientation documents the default orientation of characters in this scenario.

This report describes a Unicode character property which can serve as a stable default orientation of characters for reliable document interchange. The actual choice for the property should result in a legible default, but it may not be publishing-material quality, or may not be a good choice if used in a specific style or context.

For the purpose of reliable document interchange, the property defines a default unambiguous value, so that implementation would be able to render a character stream based solely on the property values in case of non-existence of other information.

Various factors affect how text is actually orineted in vertical flow. This document assumes that high-level protocols exist to override the default orientations provided by the property. The property values are chosen to match to existing practice in Japan and then other East Asian environment. For characters that have not been used in such environments, similarity to existing characters is considered. It would be usable to display plain text, but may not be good quality for some styles or for other environments. High-level protocols could implement such various styles using tailoring.

The scope of the property is limited by the scope of Unicode itself. For example, Unicode does not support directly the representation of texts and inscriptions using Egyptian Hieroglyphs. Instead, Unicode provides characters intended for use when writing about such texts or inscriptions, or for use in conjunction with a markup system such as the Manuel de Codage. While the properties are defined for Egyptian Hieroglyphs, they are meaningful only for occurrences of these characters in discursive texts; when the characters are used with markup, the markup controls the orientation. See [Unicode], section 14.8 for a more complete discussion of the scope of Egyptian Hieroglyph characters.

3 Conformance

The propertyies and algorithms presented in this report are informative. The intent is to provide a reasonable determination of the orientation of characters which can be used in the absence of other information, but can be overridden by the context, such as markup in a document or preferences in a layout application. This default determination is based on the most common use of a character, but in no way implies that that character is used only in that way.

For more information on the conformance implications, see [Unicode], section 3.5, Properties, in particular the definition (D35) of an informative property.

4 The mvo Property

Should we rename back to VO as this is the property for interchange?

4.1 Property values

The possible property valuesThe properties share the same set of values, which are given in table 1.

Table 1. Property Values

U characters which are displayed upright, with the same orientation as they appears in the code charts.
R characters which are displayed sideways, rotated 90 degrees clockwise compared to the code charts.
L characters which are displayed sideways, rotated 90 degrees counter-clockwise compared to the code charts.
T, Tu, Tr characters which are not just upright or sideways, but require a different glyph than in the code charts when used in vertical texts. In addition, Tu indicates that as a fallback, the character can be displayed with the code chart glyph upright; similarly, Tr indicates a possible fallback using the code chart glyph rotated 90 degrees clockwise.

Note that the orientation is described with respect to the appearance in the code charts.

Currently, there are no code points with Horizontal Orientation property value L, T, Tu or Tr; there are no code points with Stacked and Mixed Orientation property value L.

4.2 Properties

The Horizontal Orientation (short name ho) property is intended to be used for horizontal lines.

The Stacked Vertical Orientation (short name svo) property is intended to be used for vertical lines in those parts of the world where characters are mostly upright.

The Mixed Vertical Orientation (short name mvo) property is intended to be used for vertical lines in East Asia, and more specifically in Japan, China and Korea.

The scope of these properties is limited by the scope of Unicode itself. For example, Unicode does not support directly the representation of texts and inscriptions using Egyptian Hieroglyphs. Instead, Unicode provides characters intended for use when writing about such texts or inscriptions, or for use in conjunction with a markup system such as the Manuel de Codage. While the properties are defined for Egyptian Hieroglyphs, they are meaningful only for occurrences of these characters in discursive texts; when the characters are used with markup, the markup controls the orientation. See [Unicode], section 14.8 for a more complete discussion of the scope of Egyptian Hieroglyph characters.

4.3 Grapheme Clusters

As in all matters of typography, the interesting unit of text is not the character, but a grapheme cluster: it does not make sense to use a base character upright and a combining mark attached to it sideways. Implementations should apply the orientation to each grapheme cluster.

It is expected that the client of the properties defined here will select a notion of grapheme cluster, and is interested in obtaining an orientation for the cluster as a whole.

A possible choice for the notion of grapheme cluster is either that of legacy grapheme cluster or that of extended grapheme cluster, as defined in [UAX29].

The orientation for a grapheme cluster as a whole is then determined by taking the orientation of the first character in the cluster, with the following exceptions:

4.4 Vertical Glyphs in the Code Charts

The Unicode code charts generally show characters in the same orientation as in horizontal lines. However, there are a few exceptions, mostly for characters or scripts which are normally written in vertical lines; in those cases, the code charts show the characters in the same orientation as in vertical lines. Furthermore, those vertical characters and scripts are often rotated when displayed in horizontal lines; figure 4 shows an example of Mongolian text in horizontal lines, where the Mongolian characters are rotated 90 degree counter-clockwise with respect to the code charts.

Figure 4. Mongolian text on horizontal lines

Some font systems implement counter-closewise rotated glyphs from the code charts for such code points, and expect applications to render them by rotating clockwise in vertical flow. For example, OpenType fonts typically follow this convention for Mongolian and Phags-pa.

While this property only defines orientations compared to the code charts, high-level protocols or applications that use such font systems could combine font specifications with the property values to calculate in which orientations they should render such glyphs, in order to get the correct visual orientations.

5 Tailorings

This section may no longer apply well to the scope. Should we remove?

To facilitate tailorings, this report identifies sets of characters which behave similarly, and for which it can useful to tailor the orientation as a group.

5.1 The brackets

This set contains brackets, which while they appear rotated, are commonly implemented as if they were transformed.

Table 2. The brackets set

00AB
00BB
201C..201F
2039..203A
2045..2046
3008..3011
3014..301B
FE59..FE5E
FF08..FF09
FF3B
FF3D
FF5B
FF5D
FF5F..FF60
FF62..FF63

5.2 The arrows

This set contains arrows.

Table 3. The arrows set

2190..21FF
261A..261F
2794
2798..27AF
27B1..27BE
27F0..27FF
2900..297F
2B00..2B11
2B30..2B4C
FFE9..FFEC

6 Glyphs Changes for Vertical Orientation

This section is not updated for draft #7 yet.

Table 4 provides representative glyphs for the horizontal and vertical appearance of characters with the property value T.

Need to find glyphs for a few entries.

Recently, the brackets have been made T, because they have a slightly different position in their box between horizontal and vertical. It is arguable whether characters for which the difference is only a slight position adjustment should be included in T.

Table 4. Glyph Changes for Vertical Orientation

character H V
U+2018 LEFT SINGLE QUOTATION MARK
U+2019 RIGHT SINGLE QUOTATION MARK
U+201A SINGLE LOW-9 QUOTATION MARK
U+201B SINGLE HIGH-REVERSED-9 QUOTATION MARK
U+201C LEFT DOUBLE QUOTATION MARK
U+201D RIGHT DOUBLE QUOTATION MARK
U+201E DOUBLE LOW-9 QUOTATION MARK
U+201F DOUBLE HIGH-REVERSED-9 QUOTATION MARK
U+3001 IDEOGRAPHIC COMMA
U+3002 IDEOGRAPHIC FULL STOP
U+3008 LEFT ANGLE BRACKET
U+3009 RIGHT ANGLE BRACKET
U+300A LEFT DOUBLE ANGLE BRACKET
U+300B RIGHT DOUBLE ANGLE BRACKET
U+300C LEFT CORNER BRACKET
U+300D RIGHT CORNER BRACKET
U+300E LEFT WHITE CORNER BRACKET
U+300F RIGHT WHITE CORNER BRACKET
U+3010 LEFT BLACK LENTICULAR BRACKET
U+3011 RIGHT BLACK LENTICULAR BRACKET
U+3014 LEFT TORTOISE SHELL BRACKET
U+3015 RIGHT TORTOISE SHELL BRACKET
U+3016 LEFT WHITE LENTICULAR BRACKET
U+3017 RIGHT WHITE LENTICULAR BRACKET
U+3018 LEFT WHITE TORTOISE SHELL BRACKET
U+3019 RIGHT WHITE TORTOISE SHELL BRACKET
U+301A LEFT WHITE SQUARE BRACKET
U+301B RIGHT WHITE SQUARE BRACKET
U+301C WAVE DASH
U+301D REVERSED DOUBLE PRIME QUOTATION MARK
U+301E DOUBLE PRIME QUOTATION MARK
U+301F LOW DOUBLE PRIME QUOTATION MARK
U+3030 WAVY DASH
U+3041 HIRAGANA LETTER SMALL A
U+3043 HIRAGANA LETTER SMALL I
U+3045 HIRAGANA LETTER SMALL U
U+3047 HIRAGANA LETTER SMALL E
U+3049 HIRAGANA LETTER SMALL O
U+3063 HIRAGANA LETTER SMALL TU
U+3083 HIRAGANA LETTER SMALL YA
U+3085 HIRAGANA LETTER SMALL YU
U+3087 HIRAGANA LETTER SMALL YO
U+308E HIRAGANA LETTER SMALL WA
U+3095 HIRAGANA LETTER SMALL KA
U+3096 HIRAGANA LETTER SMALL KE
U+309B KATAKANA-HIRAGANA VOICED SOUND MARK
U+309C KATAKANA-HIRAGANA SEMI-VOICED SOUND MARK
U+309D HIRAGANA ITERATION MARK
U+309E HIRAGANA VOICED ITERATION MARK
U+30A0 KATAKANA-HIRAGANA DOUBLE HYPHEN
U+30A1 KATAKANA LETTER SMALL A
U+30A3 KATAKANA LETTER SMALL I
U+30A5 KATAKANA LETTER SMALL U
U+30A7 KATAKANA LETTER SMALL E
U+30A9 KATAKANA LETTER SMALL O
U+30C3 KATAKANA LETTER SMALL TU
U+30E3 KATAKANA LETTER SMALL YA
U+30E5 KATAKANA LETTER SMALL YU
U+30E7 KATAKANA LETTER SMALL YO
U+30EE KATAKANA LETTER SMALL WA
U+30F5 KATAKANA LETTER SMALL KA
U+30F6 KATAKANA LETTER SMALL KE
U+30FC KATAKANA-HIRAGANA PROLONGED SOUND MARK
U+31F0 KATAKANA LETTER SMALL KU
U+31F1 KATAKANA LETTER SMALL SI
U+31F2 KATAKANA LETTER SMALL SU
U+31F3 KATAKANA LETTER SMALL TO
U+31F4 KATAKANA LETTER SMALL NU
U+31F5 KATAKANA LETTER SMALL HA
U+31F6 KATAKANA LETTER SMALL HI
U+31F7 KATAKANA LETTER SMALL HU
U+31F8 KATAKANA LETTER SMALL HE
U+31F9 KATAKANA LETTER SMALL HO
U+31FA KATAKANA LETTER SMALL MU
U+31FB KATAKANA LETTER SMALL RA
U+31FC KATAKANA LETTER SMALL RI
U+31FD KATAKANA LETTER SMALL RU
U+31FE KATAKANA LETTER SMALL RE
U+31FF KATAKANA LETTER SMALL RO
U+3300 SQUARE APAATO
U+3301 SQUARE ARUHUA
U+3302 SQUARE ANPEA
U+3303 SQUARE AARU
U+3304 SQUARE ININGU
U+3305 SQUARE INTI
U+3306 SQUARE UON
U+3307 SQUARE ESUKUUDO
U+3308 SQUARE EEKAA
U+3309 SQUARE ONSU
U+330A SQUARE OOMU
U+330B SQUARE KAIRI
U+330C SQUARE KARATTO
U+330D SQUARE KARORII
U+330E SQUARE GARON
U+330F SQUARE GANMA
U+3310 SQUARE GIGA
U+3311 SQUARE GINII
U+3312 SQUARE KYURII
U+3313 SQUARE GIRUDAA
U+3314 SQUARE KIRO
U+3315 SQUARE KIROGURAMU
U+3316 SQUARE KIROMEETORU
U+3317 SQUARE KIROWATTO
U+3318 SQUARE GURAMU
U+3319 SQUARE GURAMUTON
U+331A SQUARE KURUZEIRO
U+331B SQUARE KUROONE
U+331C SQUARE KEESU
U+331D SQUARE KORUNA
U+331E SQUARE KOOPO
U+331F SQUARE SAIKURU
U+3320 SQUARE SANTIIMU
U+3321 SQUARE SIRINGU
U+3322 SQUARE SENTI
U+3323 SQUARE SENTO
U+3324 SQUARE DAASU
U+3325 SQUARE DESI
U+3326 SQUARE DORU
U+3327 SQUARE TON
U+3328 SQUARE NANO
U+3329 SQUARE NOTTO
U+332A SQUARE HAITU
U+332B SQUARE PAASENTO
U+332C SQUARE PAATU
U+332D SQUARE BAARERU
U+332E SQUARE PIASUTORU
U+332F SQUARE PIKURU
U+3330 SQUARE PIKO
U+3331 SQUARE BIRU
U+3332 SQUARE HUARADDO
U+3333 SQUARE HUIITO
U+3334 SQUARE BUSSYERU
U+3335 SQUARE HURAN
U+3336 SQUARE HEKUTAARU
U+3337 SQUARE PESO
U+3338 SQUARE PENIHI
U+3339 SQUARE HERUTU
U+333A SQUARE PENSU
U+333B SQUARE PEEZI
U+333C SQUARE BEETA
U+333D SQUARE POINTO
U+333E SQUARE BORUTO
U+333F SQUARE HON
U+3340 SQUARE PONDO
U+3341 SQUARE HOORU
U+3342 SQUARE HOON
U+3343 SQUARE MAIKURO
U+3344 SQUARE MAIRU
U+3345 SQUARE MAHHA
U+3346 SQUARE MARUKU
U+3347 SQUARE MANSYON
U+3348 SQUARE MIKURON
U+3349 SQUARE MIRI
U+334A SQUARE MIRIBAARU
U+334B SQUARE MEGA
U+334C SQUARE MEGATON
U+334D SQUARE MEETORU
U+334E SQUARE YAADO
U+334F SQUARE YAARU
U+3350 SQUARE YUAN
U+3351 SQUARE RITTORU
U+3352 SQUARE RIRA
U+3353 SQUARE RUPII
U+3354 SQUARE RUUBURU
U+3355 SQUARE REMU
U+3356 SQUARE RENTOGEN
U+3357 SQUARE WATTO
U+337B SQUARE ERA NAME HEISEI
U+337C SQUARE ERA NAME SYOUWA
U+337D SQUARE ERA NAME TAISYOU
U+337E SQUARE ERA NAME MEIZI
U+337F SQUARE CORPORATION
U+FE50 SMALL COMMA
U+FE51 SMALL IDEOGRAPHIC COMMA
U+FE52 SMALL FULL STOP
U+FE59 SMALL LEFT PARENTHESIS
U+FE5A SMALL RIGHT PARENTHESIS
U+FE5B SMALL LEFT CURLY BRACKET
U+FE5C SMALL RIGHT CURLY BRACKET
U+FE5D SMALL LEFT TORTOISE SHELL BRACKET
U+FE5E SMALL RIGHT TORTOISE SHELL BRACKET
U+FF01 FULLWIDTH EXCLAMATION MARK
U+FF08 FULLWIDTH LEFT PARENTHESIS
U+FF09 FULLWIDTH RIGHT PARENTHESIS
U+FF0C FULLWIDTH COMMA
U+FF0E FULLWIDTH FULL STOP
U+FF1A FULLWIDTH COLON
U+FF1B FULLWIDTH SEMICOLON
U+FF3B FULLWIDTH LEFT SQUARE BRACKET
U+FF3D FULLWIDTH RIGHT SQUARE BRACKET
U+FF3F FULLWIDTH LOW LINE
U+FF5B FULLWIDTH LEFT CURLY BRACKET
U+FF5C FULLWIDTH VERTICAL LINE
U+FF5D FULLWIDTH RIGHT CURLY BRACKET
U+FF5E FULLWIDTH TILDE
U+FF5F FULLWIDTH LEFT WHITE PARENTHESIS
U+FF60 FULLWIDTH RIGHT WHITE PARENTHESIS
U+FF61 HALFWIDTH IDEOGRAPHIC FULL STOP
U+FF62 HALFWIDTH LEFT CORNER BRACKET
U+FF63 HALFWIDTH RIGHT CORNER BRACKET
U+FF64 HALFWIDTH IDEOGRAPHIC COMMA
U+FF67 HALFWIDTH KATAKANA LETTER SMALL A
U+FF68 HALFWIDTH KATAKANA LETTER SMALL I
U+FF69 HALFWIDTH KATAKANA LETTER SMALL U
U+FF6A HALFWIDTH KATAKANA LETTER SMALL E
U+FF6B HALFWIDTH KATAKANA LETTER SMALL O
U+FF6C HALFWIDTH KATAKANA LETTER SMALL YA
U+FF6D HALFWIDTH KATAKANA LETTER SMALL YU
U+FF6E HALFWIDTH KATAKANA LETTER SMALL YO
U+FF6F HALFWIDTH KATAKANA LETTER SMALL TU
U+FF70 HALFWIDTH KATAKANA-HIRAGANA PROLONGED SOUND MARK
U+FFE3 FULLWIDTH MACRON
U+1F200 SQUARE HIRAGANA HOKA
U+1F201 SQUARED KATAKANA KOKO

7 Data File

The data file, in UCD syntax.

To help during the review, a slightly more readable version is available.

U+2016 ‖ DOUBLE VERTICAL LINE; JRLEQ classifies this character as cl-19 ideographic; typically, this is a clue that it is upright; also, JIS 0213:2000 does not give a vertical variant. On the other hand, it seems that 'vert' often presents it sideways. Which is right? Could it be that font vendors have been influenced by U+30A0 ゠ KATAKANA-HIRAGANA DOUBLE HYPHEN?

Acknowledgments

Please let me know if I forgot your name or you prefer a different spelling/etc.

Thanks to the original editor Eric Muller, and reviewers: Julie Allen, Ken Lunde, Nat McCully, Ken Whistler, Taro Yamamoto, htakenaka, John Cowan, Fantasai, Asmus Freytag, Van Anderson, Koji Ishii, sikeda, Shinyu Murakami, Tokushige Kobayashi, Addison Phillips, Martin Dürst, the W3C Internationalization Core Working Group, the W3C I18N Interest group, the W3C CSS Working group, Michael Everson, John Daggett, Laurențiu Iancu, Dwayne Robinson.

References

[JLREQ] Requirements for Japanese Text layout, W3C Working Group Note
[Errata] Updates and Errata

http://www.unicode.org/errata
[Feedback] http://www.unicode.org/reporting.html

For reporting errors and requesting information online.
[Reports] Unicode Technical Reports

http://www.unicode.org/reports/

For information on the status and development process for technical reports, and for a list of technical reports.
[UAX29] UAX #29: Unicode Text Segmentation

http://www.unicode.org/reports/tr29/
[Unicode] The Unicode Standard, Version 6.1.0, defined by: The Unicode Standard, Version 6.1.0 (Mountain View, CA: The Unicode Consortium, 2012. ISBN 978-1-936213-02-3)

http://www.unicode.org/versions/Unicode6.1.0
[Versions] Versions of the Unicode Standard

http://www.unicode.org/versions/

For details on the precise contents of each version of the Unicode Standard, and how to cite them.

Modifications

This section indicates the changes introduced by each revision.

Revision 7

Revision 6

Revision 5

Revision 4

Revision 3

Revision 2

Revision 1