From: "Feng, Bob C" <bob.c.feng@intel.com>
To: "Gao, Liming" <liming.gao@intel.com>,
"edk2-devel@lists.01.org" <edk2-devel@lists.01.org>
Subject: Re: [Patch] BaseTool: Add cache for the result of SkipAutogen.
Date: Mon, 2 Jul 2018 03:13:10 +0000 [thread overview]
Message-ID: <08650203BA1BD64D8AD9B6D5D74A85D15548921A@SHSMSX101.ccr.corp.intel.com> (raw)
In-Reply-To: <4A89E2EF3DFEDB4C8BFDE51014F606A14E2A0919@SHSMSX104.ccr.corp.intel.com>
Hi Liming,
Based on my testing, a module will enter the CanSkip() multiple times even after CanSkip() return True.
In this patch, I cache the module after CanSkip() return True to save the cost of later CanSkip() evaluation.
I think the CanSkip() will always return True after it return True at first time in one build process.
Thanks,
Bob
-----Original Message-----
From: Gao, Liming
Sent: Monday, July 02, 2018 10:53 AM
To: Feng, Bob C <bob.c.feng@intel.com>; edk2-devel@lists.01.org
Subject: RE: [Patch] BaseTool: Add cache for the result of SkipAutogen.
Bob:
When will this cache take effective?
Thanks
Liming
>-----Original Message-----
>From: Feng, Bob C
>Sent: Monday, July 02, 2018 9:16 AM
>To: edk2-devel@lists.01.org
>Cc: Feng, Bob C <bob.c.feng@intel.com>; Gao, Liming
><liming.gao@intel.com>
>Subject: [Patch] BaseTool: Add cache for the result of SkipAutogen.
>
>Add a cache for the value of skip ModuleAutoGen process flag. This
>cache can improve build performance.
>
>Contributed-under: TianoCore Contribution Agreement 1.1
>Signed-off-by: Bob Feng <bob.c.feng@intel.com>
>Cc: Liming Gao <liming.gao@intel.com>
>---
> BaseTools/Source/Python/AutoGen/AutoGen.py | 4 ++++
> BaseTools/Source/Python/Common/GlobalData.py | 1 +
> 2 files changed, 5 insertions(+)
>
>diff --git a/BaseTools/Source/Python/AutoGen/AutoGen.py
>b/BaseTools/Source/Python/AutoGen/AutoGen.py
>index 381dbc0a71..fc242992b7 100644
>--- a/BaseTools/Source/Python/AutoGen/AutoGen.py
>+++ b/BaseTools/Source/Python/AutoGen/AutoGen.py
>@@ -4305,15 +4305,18 @@ class ModuleAutoGen(AutoGen):
>
> ## Decide whether we can skip the ModuleAutoGen process
> def CanSkipbyHash(self):
> if GlobalData.gUseHashCache:
> return not self.GenModuleHash()
>+ return False
>
> ## Decide whether we can skip the ModuleAutoGen process
> # If any source file is newer than the module than we cannot skip
> #
> def CanSkip(self):
>+ if self.MetaFile in GlobalData.gSikpAutoGenCache:
>+ return True
> if not os.path.exists(self.GetTimeStampPath()):
> return False
> #last creation time of the module
> DstTimeStamp = os.stat(self.GetTimeStampPath())[8]
>
>@@ -4328,10 +4331,11 @@ class ModuleAutoGen(AutoGen):
> return False
> if source not in ModuleAutoGen.TimeDict :
> ModuleAutoGen.TimeDict[source] = os.stat(source)[8]
> if ModuleAutoGen.TimeDict[source] > DstTimeStamp:
> return False
>+ GlobalData.gSikpAutoGenCache.add(self.MetaFile)
> return True
>
> def GetTimeStampPath(self):
> if self._TimeStampPath is None:
> self._TimeStampPath = os.path.join(self.MakeFileDir,
>'AutoGenTimeStamp')
>diff --git a/BaseTools/Source/Python/Common/GlobalData.py
>b/BaseTools/Source/Python/Common/GlobalData.py
>index afb3d8f020..fac7cde708 100644
>--- a/BaseTools/Source/Python/Common/GlobalData.py
>+++ b/BaseTools/Source/Python/Common/GlobalData.py
>@@ -111,5 +111,6 @@ gBinCacheDest = None gBinCacheSource = None
>gPlatformHash = None gPackageHash = {} gModuleHash = {}
>gEnableGenfdsMultiThread = False
>+gSikpAutoGenCache = set()
>--
>2.16.2.windows.1
next prev parent reply other threads:[~2018-07-02 3:13 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-07-02 1:15 [Patch] BaseTool: Add cache for the result of SkipAutogen BobCF
2018-07-02 2:52 ` Gao, Liming
2018-07-02 3:13 ` Feng, Bob C [this message]
2018-07-03 5:42 ` Gao, Liming
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-list from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=08650203BA1BD64D8AD9B6D5D74A85D15548921A@SHSMSX101.ccr.corp.intel.com \
--to=devel@edk2.groups.io \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox