HP-UX 11.0 - 11i Internationalization Features White Paper

Encoding Characters

Converting Between Encodings

Chapter 2

Converting Between Encodings

Corrected Character Mappings to iconv (1) and iconv (3C) [11.0 patch, 11i v1]

This release contains defect fixes for incorrect character mappings. The corrections concern the Simplified

Chinese, Traditional Chinese, Japanese, and Korean characters of HP-UX.

Corrected character converter mappings allow for improved interoperability when sending or receiving

converted character data to and from Unicode-aware systems.

Correction for Simplified Chinese

A patch corrects an incorrect character mapping that occurs when converting between hp15CN and Unicode

(UCS2)/UTF-8 for Simplified Chinese.

Specifically, the Simplified Chinese character

Double Vertical Line mapped incorrectly when converting

between hp15CN and UCS2/UTF-8. This character was being mapped to the

Parallel To character, which is a

different character.

Table 2-19 summarizes the change applied to the iconv tables:

The hp15CN=ucs2 and ucs2=hp15CN iconv converter tables are affected. These tables are shared by both

UCS2 and UTF-8 conversions.

No compatibility problems are anticipated. However, if compatibility concerns arise with regard to persistent

data stored either in Unicode (UCS2) or UTF-8 on an HP-UX system, it is possible to generate a simple

conversion script to search for each occurrence of an incorrect value in either UCS2 or UTF-8 and convert it to

the correct value, based on the mapping in Table 2-20.

Correction for Traditional Chinese

A patch corrects several incorrect character mappings that occur when converting between Big-5/EUC and

Unicode (UCS2)/UTF-8 for Traditional Chinese.

Table 2-19 Changes in iconv Tables for Simplified Chinese

hp15CN Incorrect UCS2 Correct UCS2 Character Name

0xA1CE 0x2225 Parallel To

0xA1AC 0x2225 0x2016 Double Vertical Line

Table 2-20 Mapping Between Old and New Unicode Characters for Simplified

Chinese

Old UCS2 UCS2 Old UTF-8 UTF-8 Char Name

0x2225 0x2016 0xe288a5 0xe28096 Double Vertical Line