Prove it! Data Driven Conformance Testing
ICU Conformance is a new ICU project that provides tools and procedures to verify an implementation of ICU based on published data-based specifications. Testing can be extended to multiple libraries and platforms, now including NodeJS (ECMAScript), ICU4X (Rust), Dart Web, and ICU4C, applying releases of interest for each. Specifications tested can be extended, and currently include ICU /CLDR data for collation order, number formatting, language display names, and likely local subtags. Such data is available for several recent ICU / CLDR releases. Results are available publicly, including sufficient detail to analyze defects and identify root causes of failing or unsupported tests.
The talk will outline the objectives and overall implementation of the ICU Conformance project and will describe procedures to extend the scope of testing to additional platforms and test types. Conformance will be valuable for comparing ICU results across programming platforms and versions. Developers and program managers may use the conformance reports in planning and evaluate multilingual product quality and breadth of internationalization support.