From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from rn-mailsvcp-ppex-lapp24.apple.com (rn-mailsvcp-ppex-lapp24.apple.com [17.179.253.38]) by mx.groups.io with SMTP id smtpd.web11.35388.1618244862658525821 for ; Mon, 12 Apr 2021 09:27:42 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@apple.com header.s=20180706 header.b=am/Hcnzs; spf=pass (domain: apple.com, ip: 17.179.253.38, mailfrom: afish@apple.com) Received: from pps.filterd (rn-mailsvcp-ppex-lapp24.rno.apple.com [127.0.0.1]) by rn-mailsvcp-ppex-lapp24.rno.apple.com (8.16.1.2/8.16.1.2) with SMTP id 13CGMoWt018211; Mon, 12 Apr 2021 09:27:39 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=YhwuCWeavGu44+RZ/bokC/mt9+ZxoV15hd1t/d0G3Rs=; b=am/HcnzsZEOGxl5W4YE3qIUUKyNyrdbKswydKG4PzgTUQfOQOUqSOfDe91TWFrUBDt99 idHSWrEqgTKqZPuH7K8pbuCjKTGKKw1zkejmyxxMB3MKujAJZU8Nc8DxZ5wLeabd2IDz UBTFmZnxrxEwBJoAwQytXqBgaZWxYRHoUcHpvmoSQQE11x4RZ1+ObrsNXpE0A59TB111 GS9inFIO+cmRAd1dAkaJez4u3RGLnL5BnQP5UAYLquWVe5ujY6xNkfzrJJemSkuE7XQL syWq+ywEfjCqukqi2v4TvRb101EExAFWZGSmXm5Im1RhrJZtKMS0CXpb7Ryz/LLX+95X uw== Received: from rn-mailsvcp-mta-lapp03.rno.apple.com (rn-mailsvcp-mta-lapp03.rno.apple.com [10.225.203.151]) by rn-mailsvcp-ppex-lapp24.rno.apple.com with ESMTP id 37u9m92q0c-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Mon, 12 Apr 2021 09:27:39 -0700 Received: from rn-mailsvcp-mmp-lapp02.rno.apple.com (rn-mailsvcp-mmp-lapp02.rno.apple.com [17.179.253.15]) by rn-mailsvcp-mta-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPS id <0QRG00S9DLQ14AA0@rn-mailsvcp-mta-lapp03.rno.apple.com>; Mon, 12 Apr 2021 09:27:37 -0700 (PDT) Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp02.rno.apple.com by rn-mailsvcp-mmp-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) id <0QRG00700LBQOR00@rn-mailsvcp-mmp-lapp02.rno.apple.com>; Mon, 12 Apr 2021 09:27:37 -0700 (PDT) X-Va-A: X-Va-T-CD: fcd940a3063d28518664f76484c3e186 X-Va-E-CD: d2eb553ccc03b79e78b7d4b2aacadc75 X-Va-R-CD: d84ee404fb8267c0aadfe61c31816d55 X-Va-CD: 0 X-Va-ID: 9ad9d566-9360-4462-9c1e-48dc6724b531 X-V-A: X-V-T-CD: fcd940a3063d28518664f76484c3e186 X-V-E-CD: d2eb553ccc03b79e78b7d4b2aacadc75 X-V-R-CD: d84ee404fb8267c0aadfe61c31816d55 X-V-CD: 0 X-V-ID: 35ab271f-4bd0-478e-9d33-eb46f45d1625 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391,18.0.761 definitions=2021-04-12_11:2021-04-12,2021-04-12 signatures=0 Received: from [17.235.15.59] (unknown [17.235.15.59]) by rn-mailsvcp-mmp-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.7.20201203 64bit (built Dec 3 2020)) with ESMTPSA id <0QRG00XQYLPYPP00@rn-mailsvcp-mmp-lapp02.rno.apple.com>; Mon, 12 Apr 2021 09:27:35 -0700 (PDT) From: "Andrew Fish" Message-id: <693BCFB4-B9AC-411A-8E8E-5BDC9B7EB03D@apple.com> MIME-version: 1.0 (Mac OS X Mail 14.0 \(3654.20.0.2.1\)) Subject: Re: [EXTERNAL] [edk2-devel] Build Failed for QEMU35Pkg Date: Mon, 12 Apr 2021 09:27:33 -0700 In-reply-to: Cc: "Shivanshi.Pandya@dell.com" To: edk2-devel-groups-io , bret.barkelew@microsoft.com References: <5741C996-EB86-4630-AFB0-620E33E9DAB6@apple.com> X-Mailer: Apple Mail (2.3654.20.0.2.1) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391,18.0.761 definitions=2021-04-12_11:2021-04-12,2021-04-12 signatures=0 Content-type: multipart/alternative; boundary="Apple-Mail=_D940642D-DE85-4159-9BD0-85B827090F88" --Apple-Mail=_D940642D-DE85-4159-9BD0-85B827090F88 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Apr 9, 2021, at 6:33 PM, Bret Barkelew via groups.io wrote: >=20 > Andrew, > Not a scheme that I would consider a =E2=80=9Cgood=E2=80=9D scheme. You = can see what we=E2=80=99re running CI against (in Mu and EDK, both), by che= cking for the =E2=80=9CUsePythonVersion=E2=80=9D command in the .azurepipe= lines/pr-gate-steps.yml file. > Bret, If I understand correctly the CI list is the recommended versions, but not= the required versions. Do we have any concept of the required versions? I = guess we could put a python assert to enforce min Python version? I guess w= e could be more aggressive on the required Python version (forces people to= install a custom Python version for the edk2 build), or build a CI test th= at tests the min Python version for the tools... Sorry mostly thinking out loud=E2=80=A6.=20 Thanks, Andrew Fish > Shivanshi, > I just ran a build on my system with that exact version of Python (3.9.0= ). Did your build produce a =E2=80=9CBUILD_TOOLS_REPORT.json=E2=80=9D file?= If so, can you send it? > Can you also send the exact command that you=E2=80=99re running when you= see this issue? > > Thanks! > > - Bret=20 > > From: Andrew Fish > Sent: Friday, April 9, 2021 4:54 PM > To: edk2-devel-groups-io ; Bret Barkelew > Cc: Shivanshi.Pandya@dell.com > Subject: [EXTERNAL] Re: [edk2-devel] Build Failed for QEMU35Pkg > > >=20 >=20 > On Apr 9, 2021, at 1:55 PM, Bret Barkelew via groups.io > wrote: > > It looks like a Python 3.8.x vs 3.9.x issue. > > > Do we have a scheme to require a min Python version? > > Thanks, > > Andrew Fish >=20 >=20 > It looks as if you=E2=80=99re using Mu Q35 as your platform. Can you tel= l me what branch you=E2=80=99re on? > > - Bret=20 > > From: Pandya, Shivanshi via groups.io > Sent: Friday, April 9, 2021 1:52 PM > To: devel@edk2.groups.io > Subject: [EXTERNAL] [edk2-devel] Build Failed for QEMU35Pkg > > Hello, > > Build failed with following call trace > > build.py... > INFO - : error C0DE: Unknown fatal error when processing [c:\bea\dfci\m= u_tiano_platforms\Common\PRM\PrmPkg\Library\DxePrmModuleDiscoveryLib\DxePrm= ModuleDiscoveryLib.inf [X64, VS2017, DEBUG]] > INFO - > INFO - (Please send email to devel@edk2.groups.io for help, attaching following call stack trace!) > INFO - > INFO - (Python 3.9.0 on win32) Traceback (most recent call last): > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\build\build.py", line 2635, in Main > INFO - MyBuild.Launch() > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\build\build.py", line 2430, in Launch > INFO - self._MultiThreadBuildPlatform() > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\build\build.py", line 2238, in _MultiThreadBuildPlatform > INFO - Wa, self.BuildModules =3D self.PerformAutoGen(BuildTarget,Too= lChain) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\build\build.py", line 2112, in PerformAutoGen > INFO - CmdListDict =3D self._GenFfsCmd(Wa.ArchList) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\build\build.py", line 2009, in _GenFfsCmd > INFO - GenFfsDict =3D GenFds.GenFfsMakefile('', GlobalData.gFdfParse= r, self, ArchList, GlobalData) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\GenFds.py", line 541, in GenFfsMakefile > INFO - FdObj.GenFd(Flag=3DTrue) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\Fd.py", line 131, in GenFd > INFO - RegionObj.AddToBuffer (FdBuffer, self.BaseAddress, self.Block= SizeList, self.ErasePolarity, GenFdsGlobalVariable.ImageBinDict, self.Defin= eVarDict, Flag=3DFlag) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\Region.py", line 134, in AddToBuffer > INFO - FvObj.AddToBuffer(FvBuffer, FvBaseAddress, BlockSize, BlockNu= m, ErasePolarity, Flag=3DFlag) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\Fv.py", line 127, in AddToBuffer > INFO - FileName =3D FfsFile.GenFfs(MacroDict, FvParentAddr=3DBaseAdd= ress, IsMakefile=3DFlag, FvName=3Dself.UiFvName) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\FfsInfStatement.py", line 518, in GenFfs > INFO - InputSectList, InputSectAlignments =3D self.__GenComplexFileS= ection__(Rule, FvChildAddr, FvParentAddr, IsMakefile=3DIsMakefile) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\FfsInfStatement.py", line 969, in __GenComplexFileSection_= _ > INFO - SectList, Align =3D Sect.GenSection(self.OutputPath, self.Mod= uleGuid, SecIndex, self.KeyStringList, self, IsMakefile =3D IsMakefile) > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\EfiSection.py", line 218, in GenSection > INFO - GenFdsGlobalVariable.GenerateSection(OutputFile, [], 'EFI_SEC= TION_USER_INTERFACE', > INFO - File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sour= ce\Python\GenFds\GenFdsGlobalVariable.py", line 466, in GenerateSection > INFO - SectionData.fromstring(Ui.encode("utf_16_le")) > INFO - AttributeError: 'array.array' object has no attribute 'fromstring= ' > > Kind Regards, > Shivanshi > > <79C90400E51C4EC6A197393CD98D0F7A.png> > > >=20 > --Apple-Mail=_D940642D-DE85-4159-9BD0-85B827090F88 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8

On Apr 9, 20= 21, at 6:33 PM, Bret Barkelew via g= roups.io <bret.barkelew=3Dmicrosoft.com@groups.io> wrote:
Andrew,
Not a scheme that I wo= uld consider a =E2=80=9Cgood=E2=80=9D scheme. You can see what we=E2=80=99r= e running CI against (in Mu and EDK, both), by checking for the  =E2= =80=9CUsePythonVersion=E2=80=9D command in the .azurepipelines/pr-gate-ste= ps.yml file.
 

Bret,

If I understand correctly the CI list is the recommended = versions, but not the required versions. Do we have any concept of the requ= ired versions? I guess we could put a python assert to enforce min Python v= ersion? I guess we could be more aggressive on the required Python version = (forces people to install a custom Python version for the edk2 build), or b= uild a CI test that tests the min Python version for the tools...

Sorry mostly thinking out loud=E2=80=A6. 

Thanks,

<= div>Andrew Fish


Shivanshi,
I just ran a build on my system with that= exact version of Python (3.9.0). Did your build produce a =E2=80=9CBUILD_T= OOLS_REPORT.json=E2=80=9D file? If so, can you send it?
Can you also send the exact command that you=E2=80= =99re running when you see this issue?
 
Thanks!
 
- Bret 
 
From: Andrew Fish
Sent: Friday, April 9, 2021 4:54 PM
To: edk= 2-devel-groups-io; Bret Barkelew
Cc: Shivanshi.Pandya@dell.com
Subject: [EXTERNAL] = Re: [edk2-devel] Build Failed for QEMU35Pkg
 
 


On Apr 9, 2021, at 1:55 PM, Br= et Barkelew via groups.io=  <bret.barkele= w=3Dmicrosoft.com@groups.io> wrote:
 
It looks like a Python 3.8.x vs 3.9.x issue.
 
 
Do we ha= ve a scheme to require a min Python version?
 
<= div class=3D"">
Thanks,
 
Andrew Fish


It looks as if you=E2=80=99re using Mu Q35= as your platform. Can you tell me what branch you=E2=80=99re on?
 
- Bret 
 
From: = Pandya, Shivanshi= via groups.io
Sent: Friday, April 9, 2021 1:52 PM
To: devel@edk2.groups.io
Subject: [EXTERNAL= ] [edk2-devel] Build Failed for QEMU35Pkg
=
 
Hello,
 
Build failed with following call trace
 
build.py...
INFO -  : erro= r C0DE: Unknown fatal error when processing [c:\bea\dfci\mu_tiano_platforms= \Common\PRM\PrmPkg\Library\DxePrmModuleDiscoveryLib\DxePrmModuleDiscoveryLi= b.inf [X64, VS2017, DEBUG]]
INFO -
INFO - (Please send email to devel@edk2.groups.io for help, attaching following c= all stack trace!)
INFO -
INFO - (Python 3.9.0 on win32) Traceback (most recent call last):
INFO - &= nbsp; File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Source\Pyt= hon\build\build.py", line 2635, in Main
INFO -     MyBuild.Launch(= )
INFO -&nb= sp;  File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Source= \Python\build\build.py", line 2430, in Launch
INFO -     self._Mul= tiThreadBuildPlatform()
INFO -   File "C:\BEA\DFCI\mu_tiano_platforms\MU_BAS= ECORE\BaseTools\Source\Python\build\build.py", line 2238, in _MultiThreadBu= ildPlatform
INFO -     Wa, self.BuildModules =3D self.PerformAutoG= en(BuildTarget,ToolChain)
=
INFO -   File "C:\BEA\DFCI\mu_tiano_platforms\MU_B= ASECORE\BaseTools\Source\Python\build\build.py", line 2112, in PerformAutoG= en
INFO -&n= bsp;    CmdListDict =3D self._GenFfsCmd(Wa.ArchList)
INFO -  = File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Source\Python\b= uild\build.py", line 2009, in _GenFfsCmd
<= div class=3D"">
INFO -     GenFfsDict =3D= GenFds.GenFfsMakefile('', GlobalData.gFdfParser, self, ArchList, GlobalDat= a)
INFO -&n= bsp;  File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Sourc= e\Python\GenFds\GenFds.py", line 541, in GenFfsMakefile
INFO -    = FdObj.GenFd(Flag=3DTrue)
=
INFO -   File "C:\BEA\DFCI\mu_tiano_platforms\MU_B= ASECORE\BaseTools\Source\Python\GenFds\Fd.py", line 131, in GenFd
INFO -  &= nbsp;  RegionObj.AddToBuffer (FdBuffer, self.BaseAddress, self.BlockSi= zeList, self.ErasePolarity, GenFdsGlobalVariable.ImageBinDict, self.DefineV= arDict, Flag=3DFlag)
INFO -   File "C:\BEA\DFCI\mu_tiano_platforms\MU_BASECO= RE\BaseTools\Source\Python\GenFds\Region.py", line 134, in AddToBuffer
INFO - &nb= sp;   FvObj.AddToBuffer(FvBuffer, FvBaseAddress, BlockSize, Block= Num, ErasePolarity, Flag=3DFlag)
INFO -   File "C:\BEA\DFCI\mu_tiano_platfor= ms\MU_BASECORE\BaseTools\Source\Python\GenFds\Fv.py", line 127, in AddToBuf= fer
INFO -&= nbsp;    FileName =3D FfsFile.GenFfs(MacroDict, FvParentAddr= = =3DBaseAddress, IsMakefile=3DFlag, FvName=3Dself.UiFvName)=
INFO -   File "C= :\BEA\DFCI\mu_tiano_platforms\MU_BASECORE\BaseTools\Source\Python\GenFds\Ff= sInfStatement.py", line 518, in GenFfs
INFO -     InputSectList, I= nputSectAlignments =3D self.__GenComplexFileSection__(Rule, FvChildAddr, Fv= ParentAddr, IsMakefile=3DIsMakefile)
INFO -   File "C:\BEA\DFCI\mu_tiano_pla= tforms\MU_BASECORE\BaseTools\Source\Python\GenFds\FfsInfStatement.py", line= 969, in __GenComplexFileSection__
INFO -     SectList, Align =3D = Sect.GenSection(self.OutputPath, self.ModuleGuid, SecIndex, self.KeyStringL= ist, self, IsMakefile =3D IsMakefile)
INFO -   File "C:\BEA\DFCI\mu_tiano_pl= atforms\MU_BASECORE\BaseTools\Source\Python\GenFds\EfiSection.py", line 218= , in GenSection
INFO -     GenFdsGlobalVariable.GenerateSection(= OutputFile, [], 'EFI_SECTION_USER_INTERFACE',
INFO -   File "C:\BEA\DFCI\mu_= tiano_platforms\MU_BASECORE\BaseTools\Source\Python\GenFds\GenFdsGlobalVari= able.py", line 466, in GenerateSection
INFO -     SectionData.from= string(Ui.encode("utf_16_le"))
INFO - AttributeError: 'array.array' object has no at= tribute 'fromstring'
 
Kind Regards,
Shivanshi
 

<79C90400= E51C4EC6A197393CD98D0F7A.png>
 
 
<CC6C706EF927441BBD49E964355D5AA6.png>

--Apple-Mail=_D940642D-DE85-4159-9BD0-85B827090F88--