public inbox for devel@edk2.groups.io
 help / color / mirror / Atom feed
From: "Steven Shi" <steven.shi@intel.com>
To: devel@edk2.groups.io
Cc: liming.gao@intel.com, bob.c.feng@intel.com,
	christian.rodriguez@intel.com, michael.johnson@intel.com, "Shi,
	Steven" <steven.shi@intel.com>
Subject: [PATCH 0/4] Build cache enhancement
Date: Thu,  8 Aug 2019 20:25:15 +0800	[thread overview]
Message-ID: <20190808122519.25516-1-steven.shi@intel.com> (raw)

From: "Shi, Steven" <steven.shi@intel.com>

Enhance the edk2 build cache with below patches:
Patch 01/04: Improve the cache hit rate through new cache checkpoint and hash algorithm
Patch 02/04: Print more info to explain why a module build cache miss
Patch 03/04: Fix the unsafe [self.Arch][self.Name] key usage in build cache
Patch 04/04  Add the GenFds multi-thread support in build cache

This patch set is based on patch set of [Patch 00/10 V8] Enable multiple process AutoGen 
https://edk2.groups.io/g/devel/topic/patch_00_10_v8_enable/32779325?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,140,32779325

You can directly try this patch set in the branch:
https://github.com/shijunjing/edk2/tree/build_cache_improve_v1


Shi, Steven (4):
  BaseTools: Improve the cache hit in the edk2 build cache
  BaseTools: Print first cache missing file for build cachle
  BaseTools: Change the [Arch][Name] module key in Build cache
  BaseTools: Add GenFds multi-thread support in build cache

 .../Source/Python/AutoGen/AutoGenWorker.py    |  23 +
 BaseTools/Source/Python/AutoGen/CacheIR.py    |  28 +
 BaseTools/Source/Python/AutoGen/DataPipe.py   |   8 +
 BaseTools/Source/Python/AutoGen/GenMake.py    | 229 +++---
 .../Source/Python/AutoGen/ModuleAutoGen.py    | 742 ++++++++++++++++--
 BaseTools/Source/Python/Common/GlobalData.py  |   9 +
 BaseTools/Source/Python/build/build.py        | 171 ++--
 7 files changed, 979 insertions(+), 231 deletions(-)
 mode change 100644 => 100755 BaseTools/Source/Python/AutoGen/AutoGenWorker.py
 create mode 100755 BaseTools/Source/Python/AutoGen/CacheIR.py
 mode change 100644 => 100755 BaseTools/Source/Python/AutoGen/DataPipe.py
 mode change 100644 => 100755 BaseTools/Source/Python/AutoGen/GenMake.py
 mode change 100644 => 100755 BaseTools/Source/Python/AutoGen/ModuleAutoGen.py
 mode change 100644 => 100755 BaseTools/Source/Python/Common/GlobalData.py
 mode change 100644 => 100755 BaseTools/Source/Python/build/build.py

-- 
2.17.1


             reply	other threads:[~2019-08-08 12:25 UTC|newest]

Thread overview: 12+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-08-08 12:25 Steven Shi [this message]
2019-08-08 12:25 ` [PATCH 1/4] BaseTools: Improve the cache hit in the edk2 build cache Steven Shi
2019-09-06 20:45   ` commit "BaseTools: Improve the cache hit in the edk2 build cache" causes build.py unknown fatal error vladimir.olovyannikov
2019-09-07  2:16     ` Steven Shi
2019-09-09  1:22       ` Bob Feng
2019-09-09 20:14         ` Vladimir Olovyannikov
2019-09-10  1:25           ` Steven Shi
2019-09-10  1:57           ` Bob Feng
2019-08-08 12:25 ` [PATCH 2/4] BaseTools: Print first cache missing file for build cachle Steven Shi
2019-08-08 12:25 ` [PATCH 3/4] BaseTools: Change the [Arch][Name] module key in Build cache Steven Shi
2019-08-08 12:25 ` [PATCH 4/4] BaseTools: Add GenFds multi-thread support in build cache Steven Shi
2019-08-08 20:43 ` [edk2-devel] [PATCH 0/4] Build cache enhancement Laszlo Ersek

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-list from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20190808122519.25516-1-steven.shi@intel.com \
    --to=devel@edk2.groups.io \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox