Re: Edk2 uni file encoding

["Gao, Liming" <liming.gao@intel.com>]

Sean:
  EDKII UNI spec (https://github.com/tianocore/tianocore.github.io/wiki/EDK-II-Specifications) Chapter 2 defines UNI file format. EdkCompatibilityPkg is obsolete. BZ https://bugzilla.tianocore.org/show_bug.cgi?id=1103 is submitted to delete EdkCompatibilityPkg from edk2/master. We will work on it. 

EDK II Unicode files are used for mapping token names to localized strings that are
identified by an RFC4646 language code. The format for storing EDK II Unicode files on disk
is UTF-8 (without a BOM character) or UTF-16LE (with a BOM character). The character
content must be UCS-2.

Thanks
Liming
>-----Original Message-----
>From: edk2-devel [mailto:edk2-devel-bounces@lists.01.org] On Behalf Of
>Sean Brogan via edk2-devel
>Sent: Thursday, November 08, 2018 7:00 AM
>To: edk2-devel@lists.01.org
>Subject: [edk2] Edk2 uni file encoding
>
>Is there a definitive answer for the file encoding for all UNI files in edk2?
>If not I would like to propose one.  Incorrect encoding causes tool issues and is
>something we can easily check for and fix.
>
>Proposal: All UNI files in edk2 should be
>
>
>  1.  UTF-8
>Or
>
>  1.  Use a BOM and be UTF-16
>
>https://en.wikipedia.org/wiki/Byte_order_mark
>
>Results from searching edk2:
>1 - UTF-16 LE BOM file:
>EdkCompatibilityPkg\Compatibility\FrameworkHiiOnUefiHiiThunk\Strings.uni
>919 - Without BOM and decoded as UTF-8
>
>Thoughts?
>
>Future question:  Can we make rule for all other standard file types (c, h, dec,
>dsc, fdf, inf,)?
>
>Thanks
>Sean
>
>
>
>_______________________________________________
>edk2-devel mailing list
>edk2-devel@lists.01.org
>https://lists.01.org/mailman/listinfo/edk2-devel