[Unicode]   Common Locale Data Repository : Bug Tracking Home | Site Map | Search
 
Modify

CLDR Ticket #7465(accepted enhancement)

Opened 4 years ago

Last modified 2 years ago

ST SQL: move BLOB to utf8mb4

Reported by: srl Owned by: srl
Component: survey Data Locale:
Phase: dsub Review:
Weeks: Data Xpath:
Xref:

ticket:7417

Description

Early in SurveyTool development, I found that MySQL didn't support supplemental characters in its so-called "utf8" encoding. So, I switched to using BLOBs and doing my own encode-decode DBUtils.setStringUTF8...

By 2010 and MySQL 5.5.3, the utf8mb4 encoding was added which theoretically supports supplemental chars. I have not tested it. There is a migration guide here: http://dev.mysql.com/doc/refman/5.5/en/charset-unicode-utf8mb4.html

Another wrinkle is that (as I remember) when xpaths are encoded as utf-8, only 300 chars (not bytes) can be handled in the uniqueness index versus 1000 when latin1 is used.

For this reason, the SurveyTool runs in the latin1 encoding.

Investigate upgrading to use 'native' utf8mb4 and something else for xpaths (may need to switch to stringid, separate ticket)

Attachments

Change History

comment:1 Changed 4 years ago by emmons

  • Owner changed from anybody to srl
  • Priority changed from assess to major
  • Type changed from unknown to enhancement
  • Status changed from new to assigned
  • Milestone changed from UNSCH to 27dsub

comment:2 Changed 3 years ago by markus

  • Phase set to dsub
  • Milestone changed from 27dsub to 27

comment:3 Changed 3 years ago by srl

  • Milestone changed from 27 to 28

roll

comment:4 Changed 3 years ago by srl

  • Status changed from assigned to accepted

comment:5 Changed 2 years ago by emmons

  • Component changed from unknown to survey

comment:6 Changed 2 years ago by emmons

  • Milestone changed from 28 to 29

Moving all survey related to 29dsub

comment:7 Changed 2 years ago by emmons

  • Milestone changed from 29 to upcoming

Automatic move of all 29 -> upcoming

View

Add a comment

Modify Ticket

Action
as accepted
Author


E-mail address and user name can be saved in the Preferences.

 
Note: See TracTickets for help on using tickets.