public inbox for devel@edk2.groups.io
 help / color / mirror / Atom feed
From: "Gao, Liming" <liming.gao@intel.com>
To: "Feng, Bob C" <bob.c.feng@intel.com>,
	"edk2-devel@lists.01.org" <edk2-devel@lists.01.org>
Subject: Re: [Patch] BaseTool: Add cache for the result of SkipAutogen.
Date: Tue, 3 Jul 2018 05:42:15 +0000	[thread overview]
Message-ID: <4A89E2EF3DFEDB4C8BFDE51014F606A14E2A1306@SHSMSX104.ccr.corp.intel.com> (raw)
In-Reply-To: <08650203BA1BD64D8AD9B6D5D74A85D15548921A@SHSMSX101.ccr.corp.intel.com>

OK. Reviewed-by: Liming Gao <liming.gao@intel.com>

>-----Original Message-----
>From: Feng, Bob C
>Sent: Monday, July 02, 2018 11:13 AM
>To: Gao, Liming <liming.gao@intel.com>; edk2-devel@lists.01.org
>Cc: Feng, Bob C <bob.c.feng@intel.com>
>Subject: RE: [Patch] BaseTool: Add cache for the result of SkipAutogen.
>
>Hi Liming,
>
>Based on my testing, a module will enter the CanSkip() multiple times even
>after CanSkip() return True.
>In this patch, I cache the module after CanSkip() return True to save the cost
>of later CanSkip() evaluation.
>I think the CanSkip() will always return True after it return True at first time in
>one build process.
>
>Thanks,
>Bob
>
>-----Original Message-----
>From: Gao, Liming
>Sent: Monday, July 02, 2018 10:53 AM
>To: Feng, Bob C <bob.c.feng@intel.com>; edk2-devel@lists.01.org
>Subject: RE: [Patch] BaseTool: Add cache for the result of SkipAutogen.
>
>Bob:
>  When will this cache take effective?
>
>Thanks
>Liming
>>-----Original Message-----
>>From: Feng, Bob C
>>Sent: Monday, July 02, 2018 9:16 AM
>>To: edk2-devel@lists.01.org
>>Cc: Feng, Bob C <bob.c.feng@intel.com>; Gao, Liming
>><liming.gao@intel.com>
>>Subject: [Patch] BaseTool: Add cache for the result of SkipAutogen.
>>
>>Add a cache for the value of skip ModuleAutoGen process flag. This
>>cache can improve build performance.
>>
>>Contributed-under: TianoCore Contribution Agreement 1.1
>>Signed-off-by: Bob Feng <bob.c.feng@intel.com>
>>Cc: Liming Gao <liming.gao@intel.com>
>>---
>> BaseTools/Source/Python/AutoGen/AutoGen.py   | 4 ++++
>> BaseTools/Source/Python/Common/GlobalData.py | 1 +
>> 2 files changed, 5 insertions(+)
>>
>>diff --git a/BaseTools/Source/Python/AutoGen/AutoGen.py
>>b/BaseTools/Source/Python/AutoGen/AutoGen.py
>>index 381dbc0a71..fc242992b7 100644
>>--- a/BaseTools/Source/Python/AutoGen/AutoGen.py
>>+++ b/BaseTools/Source/Python/AutoGen/AutoGen.py
>>@@ -4305,15 +4305,18 @@ class ModuleAutoGen(AutoGen):
>>
>>     ## Decide whether we can skip the ModuleAutoGen process
>>     def CanSkipbyHash(self):
>>         if GlobalData.gUseHashCache:
>>             return not self.GenModuleHash()
>>+        return False
>>
>>     ## Decide whether we can skip the ModuleAutoGen process
>>     #  If any source file is newer than the module than we cannot skip
>>     #
>>     def CanSkip(self):
>>+        if self.MetaFile in GlobalData.gSikpAutoGenCache:
>>+            return True
>>         if not os.path.exists(self.GetTimeStampPath()):
>>             return False
>>         #last creation time of the module
>>         DstTimeStamp = os.stat(self.GetTimeStampPath())[8]
>>
>>@@ -4328,10 +4331,11 @@ class ModuleAutoGen(AutoGen):
>>                     return False
>>                 if source not in ModuleAutoGen.TimeDict :
>>                     ModuleAutoGen.TimeDict[source] = os.stat(source)[8]
>>                 if ModuleAutoGen.TimeDict[source] > DstTimeStamp:
>>                     return False
>>+        GlobalData.gSikpAutoGenCache.add(self.MetaFile)
>>         return True
>>
>>     def GetTimeStampPath(self):
>>         if self._TimeStampPath is None:
>>             self._TimeStampPath = os.path.join(self.MakeFileDir,
>>'AutoGenTimeStamp')
>>diff --git a/BaseTools/Source/Python/Common/GlobalData.py
>>b/BaseTools/Source/Python/Common/GlobalData.py
>>index afb3d8f020..fac7cde708 100644
>>--- a/BaseTools/Source/Python/Common/GlobalData.py
>>+++ b/BaseTools/Source/Python/Common/GlobalData.py
>>@@ -111,5 +111,6 @@ gBinCacheDest = None  gBinCacheSource = None
>>gPlatformHash = None  gPackageHash = {}  gModuleHash = {}
>>gEnableGenfdsMultiThread = False
>>+gSikpAutoGenCache = set()
>>--
>>2.16.2.windows.1



      reply	other threads:[~2018-07-03  5:42 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-07-02  1:15 [Patch] BaseTool: Add cache for the result of SkipAutogen BobCF
2018-07-02  2:52 ` Gao, Liming
2018-07-02  3:13   ` Feng, Bob C
2018-07-03  5:42     ` Gao, Liming [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-list from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4A89E2EF3DFEDB4C8BFDE51014F606A14E2A1306@SHSMSX104.ccr.corp.intel.com \
    --to=devel@edk2.groups.io \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox