From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from ma1-aaemail-dr-lapp01.apple.com (ma1-aaemail-dr-lapp01.apple.com [17.171.2.60]) by mx.groups.io with SMTP id smtpd.web11.1206.1612483852545227179 for ; Thu, 04 Feb 2021 16:10:52 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@apple.com header.s=20180706 header.b=O4Sl/EYZ; spf=pass (domain: apple.com, ip: 17.171.2.60, mailfrom: afish@apple.com) Received: from pps.filterd (ma1-aaemail-dr-lapp01.apple.com [127.0.0.1]) by ma1-aaemail-dr-lapp01.apple.com (8.16.0.42/8.16.0.42) with SMTP id 11504FIi008760; Thu, 4 Feb 2021 16:10:51 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=E0t6heYaufbDroSYF06OenypylbPXdkuoMiV978C4FU=; b=O4Sl/EYZJ5W/kD+xbo9kiEdnTyQk4PERAaIFhJm+zYf1EZSt+y7TlawFAUBHQkYYzt5U y/aOEVC5eRcMB/IH8Q3UQzAHWTpQMHb4AcfeiKfEAH4xeZsrU179Jg3U9L+LOxjKZzOh +KIoLkoJ6wh3QeYlmETYpNfLGTAlGYuqdBF+SE3k4A0/H1ucV4MwZNlMMI193b93ftUw Dh3dSjwcQrKflTMmbTtaYHTSWIh6+wyMz/1QmnvfxfRJA83V3bIA+HTVLPNFMn5o9n4p BXnlEs+ROle7nuzWt21TrRpmxQuGbOE7PaCA7o8v2BN0SuNhvdBIrU3L4Mv9Njl+Y3NJ rQ== Received: from rn-mailsvcp-mta-lapp03.rno.apple.com (rn-mailsvcp-mta-lapp03.rno.apple.com [10.225.203.151]) by ma1-aaemail-dr-lapp01.apple.com with ESMTP id 36d7087xrq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Thu, 04 Feb 2021 16:10:51 -0800 Received: from rn-mailsvcp-mmp-lapp02.rno.apple.com (rn-mailsvcp-mmp-lapp02.rno.apple.com [17.179.253.15]) by rn-mailsvcp-mta-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPS id <0QO100M3Y4I3YHF0@rn-mailsvcp-mta-lapp03.rno.apple.com>; Thu, 04 Feb 2021 16:10:51 -0800 (PST) Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp02.rno.apple.com by rn-mailsvcp-mmp-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) id <0QO100C004G3LU00@rn-mailsvcp-mmp-lapp02.rno.apple.com>; Thu, 04 Feb 2021 16:10:51 -0800 (PST) X-Va-A: X-Va-T-CD: 70a38c3f5b1d46c4b8dccb3b011be358 X-Va-E-CD: 9d84617848399215bcacda3b28bf7f29 X-Va-R-CD: 8e8a47db792b9fc13122fef88649bc07 X-Va-CD: 0 X-Va-ID: 7adb860d-eda5-43c4-a4a6-227064ef9aa2 X-V-A: X-V-T-CD: 70a38c3f5b1d46c4b8dccb3b011be358 X-V-E-CD: 9d84617848399215bcacda3b28bf7f29 X-V-R-CD: 8e8a47db792b9fc13122fef88649bc07 X-V-CD: 0 X-V-ID: 069f8aa5-ed6c-4116-b05d-919043466be5 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369,18.0.737 definitions=2021-02-04_13:2021-02-04,2021-02-04 signatures=0 Received: from [17.235.17.213] (unknown [17.235.17.213]) by rn-mailsvcp-mmp-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPSA id <0QO100OGO4I17100@rn-mailsvcp-mmp-lapp02.rno.apple.com>; Thu, 04 Feb 2021 16:10:50 -0800 (PST) From: "Andrew Fish" Message-id: MIME-version: 1.0 (Mac OS X Mail 14.0 \(3654.20.0.2.1\)) Subject: Re: [edk2-devel] EDK2 Date: Thu, 04 Feb 2021 16:10:49 -0800 In-reply-to: Cc: "Pham, Tony Q" To: edk2-devel-groups-io , Mike Kinney References: X-Mailer: Apple Mail (2.3654.20.0.2.1) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369,18.0.737 definitions=2021-02-04_13:2021-02-04,2021-02-04 signatures=0 Content-type: multipart/alternative; boundary="Apple-Mail=_F4664A09-FC03-483A-8547-39F3C26AF46A" --Apple-Mail=_F4664A09-FC03-483A-8547-39F3C26AF46A Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On Feb 4, 2021, at 3:58 PM, Michael D Kinney wrote: >=20 > Hi Tony, > > I suspect that one of your UNI files being processed by StrGather has an= invalid Unicode character in it. Can you review the UNI files in the modu= le that is being build when this error is generated? > > I would be better if this code identified the file/line number with the = issue, so that would be a good Bugzilla to enter. > Mike, I hit something like this too writing some Python. I think I ended up tell= ing the codec to ignore errors, so that might be another option? This I thi= nk the issue I saw was in C code.=20 Thanks, Andrew Fish > Mike > > From: devel@edk2.groups.io > On Behalf Of Pham, Tony Q > Sent: Thursday, February 4, 2021 1:39 PM > To: devel@edk2.groups.io > Subject: [edk2-devel] EDK2 > > Hi, > > I have a problem with build.py > > (Python 3.9.1 on win32) Traceback (most recent call last): > File "C:\edk2\BaseTools\Source\Python\build\build.py", line 2635, in M= ain > MyBuild.Launch() > File "C:\edk2\BaseTools\Source\Python\build\build.py", line 2433, in L= aunch > self._BuildModule() > File "C:\edk2\BaseTools\Source\Python\build\build.py", line 1895, in _= BuildModule > Ma.CreateCodeFile(True) > File "C:\edk2\BaseTools\Source\Python\AutoGen\ModuleAutoGen.py", line = 1832, in CreateCodeFile > for File in self.AutoGenFileList: > File "C:\edk2\BaseTools\Source\Python\Common\caching.py", line 28, in = __get__ > Value =3D obj.__dict__[self._function.__name__] =3D self._function(o= bj) > File "C:\edk2\BaseTools\Source\Python\AutoGen\ModuleAutoGen.py", line = 983, in AutoGenFileList > GenC.CreateCode(self, AutoGenC, AutoGenH, StringH, AutoGenUniIdf, Un= iStringBinBuffer, StringIdf, AutoGenUniIdf, IdfGenBinBuffer) > File "C:\edk2\BaseTools\Source\Python\AutoGen\GenC.py", line 2044, in = CreateCode > CreateUnicodeStringCode(Info, AutoGenC, StringH, UniGenCFlag, UniGen= BinBuffer) > File "C:\edk2\BaseTools\Source\Python\AutoGen\GenC.py", line 1706, in = CreateUnicodeStringCode > Header, Code =3D GetStringFiles(Info.UnicodeFileList, SrcList, IncLi= st, Info.IncludePathList, ['.uni', '.inf'], Info.Name, CompatibleMode, Shel= lMode, UniGenCFlag, UniGenBinBuffer, FilterInfo) > File "C:\edk2\BaseTools\Source\Python\AutoGen\StrGather.py", line 563,= in GetStringFiles > Uni =3D SearchString(Uni, sorted (FileList), IsCompatibleMode) > File "C:\edk2\BaseTools\Source\Python\AutoGen\StrGather.py", line 532,= in SearchString > for Line in Lines: > File "C:\Users\tqpham\AppData\Local\Programs\Python\Python39\lib\encod= ings\cp1252.py", line 23, in decode > return codecs.charmap_decode(input,self.errors,decoding_table)[0] > UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 5= 457: character maps to > > > - Failed - > Build end time: 13:36:22, Feb.04 2021 > Build total time: 00:00:02 >=20 --Apple-Mail=_F4664A09-FC03-483A-8547-39F3C26AF46A Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii
On Feb 4,= 2021, at 3:58 PM, Michael D Kinney <michael.d.kinney@intel.com> wrote:

Hi Tony,
 <= /div>
I suspect that one of your UNI files b= eing processed by StrGather = ;has an invalid Unicode character in it.  Can you review the UNI= files in the module that is being build when this error is generated?
 
I would be bett= er if this code identified the file/line number with the issue, so that wou= ld be a good Bugzilla to enter.
 

Mike,

I hit something like this too writing some Python. I think I e= nded up telling the codec to ignore errors, so that might be another option= ? This I think the issue I saw was in C code. 

Thanks,

Andrew Fish
<= br class=3D"">
Mike
 
From: devel@edk2.groups.io <devel@edk2.gro= ups.io> On Behalf Of P= ham, Tony Q
Sent: Thursday, February 4, 2021 1:39 PM
<= b class=3D"">To: devel@edk2.groups.io
= Subject: [edk2-devel] EDK2
 
Hi,=
 
I have a problem with build.py
<= o:p class=3D""> 
(Python 3.9.1 on win32) Tra= ceback (most recent call last):
&= nbsp; File "C:\edk2\BaseTools\Source\Python\build\build.py", line 2635, in = Main
    MyBuild.L= aunch()
  File "C:\edk2\Base= Tools\Source\Python\build\build.py", line 2433, in Launch
    self._BuildModule()
  File "C:\edk2\BaseTools\Source\Pyt= hon\build\build.py", line 1895, in _BuildModule
=
    Ma.CreateCodeFile(True)
  File "C:\edk2\BaseTools\Source\Python\AutoG= en\ModuleAutoGen.py", line 1832, in CreateCodeFile
    for File in self.AutoGenFileList:
  File "C:\edk2\BaseTools\Source= \Python\Common\caching.py", line 28, in __get__
=
    Value =3D obj.__dict__[self._function.__n= ame__] =3D self._function(obj)
&n= bsp; File "C:\edk2\BaseTools\Source\Python\AutoGen\ModuleAutoGen.py", line = 983, in AutoGenFileList
 &nb= sp;  GenC.CreateCode(self, AutoGenC, AutoGenH, StringH, AutoGenUniIdf,= UniStringBinBuffer, StringIdf, AutoGenUniIdf, IdfGenBinBuffer)
  File "C:\edk2\BaseTools\Source\Pyt= hon\AutoGen\GenC.py", line 2044, in CreateCode
<= div style=3D"margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif= ;" class=3D"">    CreateUnicodeStringCode(Info, AutoGenC, St= ringH, UniGenCFlag, UniGenBinBuffer)
  File "C:\edk2\BaseTools\Source\Python\AutoGen\GenC.py", line = 1706, in CreateUnicodeStringCode
=     Header, Code =3D GetStringFiles(Info.UnicodeFileList, Sr= cList, IncList, Info.IncludePathList, ['.uni', '.inf'], Info.Name, Compatib= leMode, ShellMode, UniGenCFlag, UniGenBinBuffer, FilterInfo)
  File "C:\edk2\BaseTools\Source\Python\Au= toGen\StrGather.py", line 563, in GetStringFiles
    Uni =3D SearchString(Uni, sorted (FileLi= st), IsCompatibleMode)
  Fil= e "C:\edk2\BaseTools\Source\Python\AutoGen\StrGather.py", line 532, in Sear= chString
    for L= ine in Lines:
  File "C:\Use= rs\tqpham\AppData\Local\Programs\Python\Python39\lib\encodings\cp1252.py", = line 23, in decode
  &n= bsp; return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec c= an't decode byte 0x9d in position 5457: character maps to <undefined>=
 
 
- Failed = -
Build end time: 13:36:22, Feb.0= 4 2021
Build total time: 00:00:02=


--Apple-Mail=_F4664A09-FC03-483A-8547-39F3C26AF46A--