From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by mx.groups.io with SMTP id smtpd.web10.423.1597269285945921461 for ; Wed, 12 Aug 2020 14:54:46 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@intel.onmicrosoft.com header.s=selector2-intel-onmicrosoft-com header.b=BW5xUAh/; spf=pass (domain: intel.com, ip: 134.134.136.65, mailfrom: jaben.carsey@intel.com) IronPort-SDR: +/LsUW260Zx7+5lAnHfZPmePW9ovz/5+Akutsv/FIjHCaQjMI6KhLBgvCxRaQ/TgTrLhKtRISu rhB23ZohDmIw== X-IronPort-AV: E=McAfee;i="6000,8403,9711"; a="154055868" X-IronPort-AV: E=Sophos;i="5.76,305,1592895600"; d="scan'208";a="154055868" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by orsmga103.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Aug 2020 14:54:44 -0700 IronPort-SDR: 04td82bh7axy8yq5pLjXhmw6FagYV2PzgCw1vyoMQhn3gjwex2yhU+NJwYH8EcbJ1SVss3ISs6 kvd/pdPanaiQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.76,305,1592895600"; d="scan'208";a="332934891" Received: from fmsmsx602-2.cps.intel.com (HELO fmsmsx602.amr.corp.intel.com) ([10.18.84.212]) by FMSMGA003.fm.intel.com with ESMTP; 12 Aug 2020 14:54:44 -0700 Received: from fmsmsx602.amr.corp.intel.com (10.18.126.82) by fmsmsx602.amr.corp.intel.com (10.18.126.82) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Wed, 12 Aug 2020 14:54:44 -0700 Received: from fmsmsx105.amr.corp.intel.com (10.18.124.203) by fmsmsx602.amr.corp.intel.com (10.18.126.82) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1713.5 via Frontend Transport; Wed, 12 Aug 2020 14:54:44 -0700 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by FMSMSX105.amr.corp.intel.com (10.18.124.203) with Microsoft SMTP Server (TLS) id 14.3.439.0; Wed, 12 Aug 2020 14:54:43 -0700 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (104.47.58.173) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.1713.5; Wed, 12 Aug 2020 14:54:43 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=YOIQx5qJDdTWgQQz/dHO3H1p7Li/Zxius61TrSJR7NKYPI+FA89VVm0mJGyLWgN4MBLJ1nrsRCcXsAWoR/fAV9USYWQbSV60X9B/1aNrKGm73pdhKnL8HLuT2OxcNnGlJkHH9YhfTlX9irhvkRVKLqyElxP/errYJkNseVcpkHAel2ONWtIeYyTKAqYDaYoYz9BwlgggMBANs98rR2KwHd7sCALxHDRxLQYlTtBiXIb2pD9ymUZWcHJOKEuAG/5AxSFq/Hfwx3HwcnAo14exij6PpJOuDIKjwmSswOZ18Lt2xylVmBnhY4U7PBR2kX6aoenMUXrh+R2tNCItUbEVRA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ejmbyS2Ek8Zl4NENN343ZlPPwJXhzcwDoVO7BNbMWMo=; b=Pp3fG/bMYdQLHKA2dUI87MW8OT89NVJ5v2CrHi9RfkOEVN8OUJ6KgG0242RFiVG0UV6z4JhMUvJgixe+NAzD0oK+U6geA0JS6MgbUGmWY88b0dluK+j2IlTr//Zz+nSreo5HHJ+CkkWvOcmiCWCsxl4hXevIc3z1876NfeHsr4Wx2x+HyQToK6HMwvy1Wuv2gs62b+fYFA9dX/CBR5ZZUUZbVbNpPodpYEgETHDK7wUhQBgS9l530zymqOOhoEbh0B/UqXG3BUZ1MFdLUKa+0ZTliPS2BWOzH8vM3HO0YzR9YKyplV086DgrPWkgFqr1fgCv1GslNR7dJE3HyAWX/w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ejmbyS2Ek8Zl4NENN343ZlPPwJXhzcwDoVO7BNbMWMo=; b=BW5xUAh/MORsAyEw5u5nXqFEBZSW8SowiSCKjYgfvxf2+/z3AKCgsEhRrcwX5Oj5fk9poH6w0CGtu6zLzMNPZsZ27nWBZq/d1Aiz4na2d3H7DGOf90wHs08nyVmQ4wlyCU/FWag9t+7Nll3m2cjLa12L2jf6ZWU1uUwPEXFff0E= Received: from MW3PR11MB4620.namprd11.prod.outlook.com (2603:10b6:303:54::14) by MWHPR1101MB2320.namprd11.prod.outlook.com (2603:10b6:301:53::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3261.15; Wed, 12 Aug 2020 21:54:42 +0000 Received: from MW3PR11MB4620.namprd11.prod.outlook.com ([fe80::81a7:b692:72d5:a525]) by MW3PR11MB4620.namprd11.prod.outlook.com ([fe80::81a7:b692:72d5:a525%8]) with mapi id 15.20.3261.024; Wed, 12 Aug 2020 21:54:42 +0000 From: "Carsey, Jaben" To: "devel@edk2.groups.io" , "Feng, Bob C" CC: "Gao, Liming" , "Chen, Christine" Subject: Re: [edk2-devel] [Patch] BaseTools: Move CreateAsBuiltInf into AutoGenWorker for parallel Thread-Topic: [edk2-devel] [Patch] BaseTools: Move CreateAsBuiltInf into AutoGenWorker for parallel Thread-Index: AQHWcG8ftL0SBN6G50u5LeDKQAcTIqk1BXuw Date: Wed, 12 Aug 2020 21:54:42 +0000 Message-ID: References: <20200812060903.23704-1-bob.c.feng@intel.com> In-Reply-To: <20200812060903.23704-1-bob.c.feng@intel.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-reaction: no-action dlp-version: 11.5.1.3 dlp-product: dlpe-windows authentication-results: edk2.groups.io; dkim=none (message not signed) header.d=none;edk2.groups.io; dmarc=none action=none header.from=intel.com; x-originating-ip: [50.38.115.52] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 81e9ced9-8b1a-4053-1be9-08d83f0a51bc x-ms-traffictypediagnostic: MWHPR1101MB2320: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:538; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: mzs79BR+2tmRzVEVUxnp6uhhrxugHNexTmoxrAME6RstyDf/u4KR4sGkGMBuFC5qCk3tA2hEpzKE9sn+6bba3aDfH/qcv3/qF3rueNd2lDHbGguoHkcizSoGcNf/1vzvPB9GYQYpmbXU0fyciTjtm5v+sb8kC/sWl/uNo/2sULxBBk56An9zqORy8EPgf7JPFlwqlXBzzv3vkxzbguXFAJTPKrpxw8Vlcw8PohVhYcKLX5SjrwbP6KTZk2H/Tf00WljnCsiDqXQw7rgne9flgN7bJfUvB6Ofdz7W2ZyHdyiNxFuDCIeK0+/ZAaRjDYS8C+vp0bEFJTq7UdorBrgvOxJ75qzbKH/yW+BbNHiKY0/nAOcH0udNfYrrY8H5maOdmOs2K34D1ftwh0tzFpu4Yg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MW3PR11MB4620.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFTY:;SFS:(6029001)(4636009)(366004)(376002)(39860400002)(346002)(136003)(396003)(33656002)(478600001)(8676002)(186003)(52536014)(7696005)(6506007)(53546011)(5660300002)(6636002)(26005)(8936002)(966005)(83380400001)(76116006)(66946007)(66476007)(66446008)(2906002)(71200400001)(86362001)(55016002)(54906003)(4326008)(110136005)(66556008)(316002)(107886003)(9686003)(64756008);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata: 7MTPbUSDiIxoifQDLLHJ7CgWWr15cdjaq0TnwKJkqltJHaf87ttyF7jd97F+FPcdxg2wpBDiFFhJmarswVIV4LIfU6uYB3RaWJf4l58YjKIFXHOBZsRhDPTba+Hj8M41C89MAMEBqmdrDkdWITbs3GYG1cIqAsSdocsAN//snr+V4D98loXXPyiyaqWNL88IFDEvcdY6/uWjc7LrEBv4dREldbkq01hFL9hcJczbQ2QvEwdV23tkcbAffGqBUmK2XVih5ZpjGZK+spI42XOcFweU9YsTPDUY/34LphkW278ZnYPU2CVSy57VEqg1yGGgliXMs3VhGRDCFgWPyB+int6PPdMgxlrHzbPbd8kLkfmVil2FJXV29kVByR2jZLXeriLTXm2+opN7Nda/1+aFpu5oWp3DAS0zrExA7BhL7Kqqw5pf+KareVxz7UUGF09bFnFVShnxSdqYakhi4CyOcDjOe5rNGSxlymnVwFTHmTO0xq8dvsorwhB2NjnkWFO9H4k07+ZsYehHZ2qDg+zzmghFENxQuioiQPqROwn82XwNwyWwaPqzX7rXij5tZq/A1UHcztUs72M1ChkQJoCldBjb4S6dk4K12Bt+OyxyZTc6apwtNUzvnxZLsGfka/qqKY2l8XRqhDK9ftUMy1ZZXw== MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MW3PR11MB4620.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 81e9ced9-8b1a-4053-1be9-08d83f0a51bc X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Aug 2020 21:54:42.5653 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: AzX5A5tKP9JkcFRYe7HdlcFiMWdexdydEy8bUPtE5UYXVijUrJxg51YQPmbNhv7AbZ1orD7RTPlCSsNqzzJqeA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR1101MB2320 Return-Path: jaben.carsey@intel.com X-OriginatorOrg: intel.com Content-Language: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Reviewed-by: Jaben Carsey > -----Original Message----- > From: devel@edk2.groups.io On Behalf Of Bob > Feng > Sent: Tuesday, August 11, 2020 11:09 PM > To: devel@edk2.groups.io > Cc: Gao, Liming ; Chen, Christine > > Subject: [edk2-devel] [Patch] BaseTools: Move CreateAsBuiltInf into > AutoGenWorker for parallel >=20 > AsBuiltInf can be created during AutoGen phase. Move CreateAsBuiltInf in= to > AutoGenWorker to make this step run in parallel. >=20 > Signed-off-by: Bob Feng > Cc: Liming Gao > Cc: Yuwei Chen > --- > BaseTools/Source/Python/AutoGen/AutoGenWorker.py | 2 +- > BaseTools/Source/Python/build/build.py | 4 +--- > 2 files changed, 2 insertions(+), 4 deletions(-) >=20 > diff --git a/BaseTools/Source/Python/AutoGen/AutoGenWorker.py > b/BaseTools/Source/Python/AutoGen/AutoGenWorker.py > index 017f676399..0425f1ab0b 100755 > --- a/BaseTools/Source/Python/AutoGen/AutoGenWorker.py > +++ b/BaseTools/Source/Python/AutoGen/AutoGenWorker.py > @@ -278,11 +278,11 @@ class AutoGenWorkerInProcess(mp.Process): > else: > self.cache_q.put((Ma.MetaFile.Path, Ma.Arch, > "PreMakeCache", False)) >=20 > Ma.CreateCodeFile(False) >=20 > Ma.CreateMakeFile(False,GenFfsList=3DFfsCmd.get((Ma.MetaFile.Path, > Ma.Arch),[])) > - > + Ma.CreateAsBuiltInf() > if GlobalData.gBinCacheSource and CommandTarget in [Non= e, "", > "all"]: > try: > CacheResult =3D Ma.CanSkipbyMakeCache() > except: > CacheResult =3D False diff --git > a/BaseTools/Source/Python/build/build.py > b/BaseTools/Source/Python/build/build.py > index 59ceacfed0..c4cfe38ad9 100755 > --- a/BaseTools/Source/Python/build/build.py > +++ b/BaseTools/Source/Python/build/build.py > @@ -871,11 +871,11 @@ class Build(): > if GlobalData.gUseHashCache and not GlobalData.gBin= CacheDest > and self.Target in [None, "", "all"]: > cqueue.put((PcdMa.MetaFile.Path, PcdMa.Arch, > "PreMakeCache", False)) >=20 > PcdMa.CreateCodeFile(False) > PcdMa.CreateMakeFile(False,GenFfsList =3D > DataPipe.Get("FfsCommand").get((PcdMa.MetaFile.Path, PcdMa.Arch),[])) > - > + PcdMa.CreateAsBuiltInf() > # Force cache miss for PCD driver > if GlobalData.gBinCacheSource and self.Target in [N= one, "", "all"]: > cqueue.put((PcdMa.MetaFile.Path, PcdMa.Arch, "M= akeCache", > False)) >=20 > self.AutoGenMgr.join() > @@ -1263,11 +1263,10 @@ class Build(): >=20 > # build modules > if BuildModule: > BuildCommand =3D BuildCommand + [Target] > LaunchCommand(BuildCommand, AutoGenObject.MakeFileDir) > - self.CreateAsBuiltInf() > if GlobalData.gBinCacheDest: > self.GenDestCache() > elif GlobalData.gUseHashCache and not GlobalData.gBinCacheS= ource: > # Only for --hash > # Update PreMakeCacheChain files @@ -2274,11 +2273,10 @= @ class > Build(): > # All modules have been put in build tasks queue. Tell = task scheduler > # to exit if all tasks are completed > # > ExitFlag.set() > BuildTask.WaitForComplete() > - self.CreateAsBuiltInf() > if GlobalData.gBinCacheDest: > self.GenDestCache() > elif GlobalData.gUseHashCache and not > GlobalData.gBinCacheSource: > # Only for --hash > # Update PreMakeCacheChain files > -- > 2.20.1.windows.1 >=20 >=20 >=20