From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: mx.groups.io; dkim=pass header.i=@linaro.org header.s=google header.b=uLdx41GY; spf=pass (domain: linaro.org, ip: 209.85.128.45, mailfrom: leif.lindholm@linaro.org) Received: from mail-wm1-f45.google.com (mail-wm1-f45.google.com [209.85.128.45]) by groups.io with SMTP; Thu, 30 May 2019 09:37:58 -0700 Received: by mail-wm1-f45.google.com with SMTP id f10so4371324wmb.1 for ; Thu, 30 May 2019 09:37:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=snbwMRC6qAIVmB80ZdHk+4tWDYo3Phm6CksUuujgQS4=; b=uLdx41GYKkjRszd9ERYUF4/mSADiRZkkoP+d1TE1vF9okkR0mArpSJx1wP9HrNKJsS F5z5iWb2ffF/QxbqD1RkmbviC2Hix0C8zR2KBpygFJ446RN/SgedT1KYOx4DrMHcBGqp rcrPl5ngPscjpTZm6tFoozb/QEXUqq4kuuEJLjSAIc++QHs/jeuHASXDmu9Z377fMDfB lRDYR9BCvfiuDLcrgCjBA0RYLTbrAFGiHCtcW8Fyt8LJeifwbPCf2HF38sfj7oheP1yF qJ7aRKH6KZnZP1neUBD9QEjTNkaxVJ73kFsIY6hoPXa5TfVpJHAqNAJyG2/5mI0orYoY stwA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=snbwMRC6qAIVmB80ZdHk+4tWDYo3Phm6CksUuujgQS4=; b=teJwa1kh0KX1I2csg3MHICAO9KPWz3d9Ko9yoP/4zoPdhbafISHXk/KoHvqlvReL77 +8r5z9Hq4wrkUwyQMQmwZ/TwBOYQKkYLiqn73Rmrcw1twDknif6mG7bbUKJgGKbJ73aQ 4YPd1akh0eLpxvD3uGgIz00rm7jjg1r8j+bIoB56hApH80zFsbZR2hFRwoURyL3w6XeU gnFYt4C4KWq/ACj1yOdvVmcjY5E3x608zByfO0cw0nIQjgKMwS5H6wdeAfhUeNEO2b1u SayrabMJrl2gIa97vhA+STeXIw66r5YKk0b2Z8ke9VbbHv8qh8Om6I5lO1XNgR0kfgln aJug== X-Gm-Message-State: APjAAAVmBr8smTRWhWPt6RhuWWIflnmK1o6p8NoM0t+gwHlvDvFxHl8j sb9wNic3OlvbQie64BMO605vkQ== X-Google-Smtp-Source: APXvYqwqXWLvc7OUooD9Oc3H5EfWdIH54QOh2n3CU9IMamzEIDrbICi6GVw8N3QmGlxR98gBewEp/Q== X-Received: by 2002:a7b:c946:: with SMTP id i6mr2853757wml.17.1559234276848; Thu, 30 May 2019 09:37:56 -0700 (PDT) Return-Path: Received: from bivouac.eciton.net (bivouac.eciton.net. [2a00:1098:0:86:1000:23:0:2]) by smtp.gmail.com with ESMTPSA id k2sm4086906wrx.84.2019.05.30.09.37.55 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 30 May 2019 09:37:55 -0700 (PDT) Date: Thu, 30 May 2019 17:37:54 +0100 From: "Leif Lindholm" To: "Feng, Bob C" Cc: "Rodriguez, Christian" , Andrew Fish , Laszlo Ersek , "Kinney, Michael D" , "devel@edk2.groups.io" , "Gao, Liming" , "Shi, Steven" , "Fan, ZhijuX" Subject: Re: Edk2 BaseTools Patches. Message-ID: <20190530163754.shb54x46euzszpza@bivouac.eciton.net> References: <08650203BA1BD64D8AD9B6D5D74A85D160128393@SHSMSX101.ccr.corp.intel.com> <20190530092802.7belyzgxdd76ps2v@bivouac.eciton.net> <3A7DCC9A944C6149BF832E1C9B718ABC01F24E6B@ORSMSX112.amr.corp.intel.com> <08650203BA1BD64D8AD9B6D5D74A85D1601296DA@SHSMSX101.ccr.corp.intel.com> MIME-Version: 1.0 In-Reply-To: <08650203BA1BD64D8AD9B6D5D74A85D1601296DA@SHSMSX101.ccr.corp.intel.com> User-Agent: NeoMutt/20170113 (1.7.2) Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Thanks Bob, Christian, On Thu, May 30, 2019 at 03:06:48PM +0000, Feng, Bob C wrote: > Thanks Christian. I add some short description for the patches. > > These 5 patches are all for binary cache feature. > > [Patch V4 2/2] BaseTools: Refactor hash tracking after checking for Sources section > [Patch V4 1/2] BaseTools: Add a checking for Sources section in INF file > > The above 2 patches is to fix the issue that > The build tool uses the files list under [sources] section of INF > file as a input to calculate a module's hash value. But in some INF > files, [sources] does not list all the "source" files, missing some > .h files. Path 2/2 use another method to get all source files for a > module and patch 1/2 do a check whether [sources] list all the > "source" files. I'll be honest - because of the wild variance in whether .h files are listed in the [sources] section of .inf files, I have always been unsure as to whether they were just being ignored (and extracted on the side via mkdep or similar). If the intent is to speed up build time, would it not be better to warn the user - so they notice the problem and fix their modules, rather than adding extra processing time on having the tools work with broken .inf files? This does not look like material for edk2-stable201905 to me. > [PATCH v3 1/1] BaseTools:Extend the binary cache to support library cache > This patch is to resolve the problem that > Build tool dose not cache the library binaries now. Whiteout this > patch, there is 25% extra time cost to rebuild the all module > dependency libraries if cache miss happen. 25% is a big number, so I won't argue against this. But I also won't argue for it - the BZ was raised very late in the cycle. > [PATCH] BaseTools:Update binary cache restore time to current time > This patch is to make the restored binary file have the current time > stamp not the binary file original time stamp. I can see how the current behaviour could cause problems with some CI/build systems. If it is properly reviewed and tested, I am OK with this one going in for edk2-stable201903. > [PATCH V5] BaseTools:Make BaseTools support new rules to generate RAW FFS FILE > This patch is to support the raw ffs file rule. Now build tool does > not correctly handle this case: > > [Rule.Common.USER_DEFINED.MicroCode] > FILE RAW = $(NAMED_GUID) { > $(INF_OUTPUT)/$(MODULE_NAME).bin > } This looks like a new feature - not something that should bypass the freeze period for edk2-stable201905. Can you explain why this is needed in the stable tag as opposed to being available from master the day after the tag is made? Best Regards, Leif > > > Thanks, > Bob > > -----Original Message----- > From: Rodriguez, Christian > Sent: Thursday, May 30, 2019 10:26 PM > To: Leif Lindholm ; Feng, Bob C > Cc: Andrew Fish ; Laszlo Ersek ; Kinney, Michael D ; devel@edk2.groups.io; Gao, Liming ; Shi, Steven ; Fan, ZhijuX > Subject: RE: Edk2 BaseTools Patches. > > Hey Leif, > > I thought I'd help Bob and gather those BZs for each thread: > > [Patch V4 1/2] BaseTools: Add a checking for Sources section in INF file [Patch V4 2/2] BaseTools: Refactor hash tracking after checking for Sources section > BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1804 > > [PATCH v3 1/1] BaseTools:Extend the binary cache to support library cache > BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1797 > > [PATCH V5] BaseTools:Make BaseTools support new rules to generate RAW FFS FILE > BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1765 > > [PATCH] BaseTools:Update binary cache restore time to current time > BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1742 > > Thanks, > Christian > > >-----Original Message----- > >From: Leif Lindholm [mailto:leif.lindholm@linaro.org] > >Sent: Thursday, May 30, 2019 2:28 AM > >To: Feng, Bob C > >Cc: Andrew Fish ; Laszlo Ersek ; > >Kinney, Michael D ; devel@edk2.groups.io; > >Gao, Liming ; Shi, Steven ; > >Rodriguez, Christian ; Fan, ZhijuX > > > >Subject: Re: Edk2 BaseTools Patches. > > > >Hi Bob, > > > >On Thu, May 30, 2019 at 06:39:59AM +0000, Feng, Bob C wrote: > >> Hi, > >> > >> Currently, we have 5 Basetools patches which are ready to push. Since > >> we are in the soft-freeze phase, I'd like to ask for your opinions if > >> those patches can be pushed to edk2 master. > > > >To save me the time of reading through all the threads and getting to > >grips with all the code, could you summarise the problem these solve > >and the impact of not including these? > > > >Is there a BZ? > > > >Regards, > > > >Leif > > > >> > >> These 5 patches are to fix the issues for the build cache feature. > >> > >> [Patch V4 2/2] BaseTools: Refactor hash tracking after checking for > >> Sources section > >> https://edk2.groups.io/g/devel/topic/31835556#41642 > >> > >> [Patch V4 1/2] BaseTools: Add a checking for Sources section in INF > >> file > >> https://edk2.groups.io/g/devel/topic/31835555#41641 > >> > >> [PATCH v3 1/1] BaseTools:Extend the binary cache to support library > >> cache > >> https://edk2.groups.io/g/devel/topic/31843505#41655 > >> > >> [PATCH V5] BaseTools:Make BaseTools support new rules to generate RAW > >> FFS FILE > >> https://edk2.groups.io/g/devel/topic/31830807#41571 > >> > >> [PATCH] BaseTools:Update binary cache restore time to current time > >> https://edk2.groups.io/g/devel/topic/31819590#41468 > >> > >> > >> Thanks, > >> Bob