From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mx.groups.io with SMTP id smtpd.web12.18856.1574155650687557305 for ; Tue, 19 Nov 2019 01:27:31 -0800 Authentication-Results: mx.groups.io; dkim=missing; spf=pass (domain: intel.com, ip: 192.55.52.88, mailfrom: steven.shi@intel.com) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga101.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 19 Nov 2019 01:27:30 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.68,322,1569308400"; d="scan'208";a="209363403" Received: from jshi19-mobl.ccr.corp.intel.com ([10.254.214.80]) by orsmga006.jf.intel.com with ESMTP; 19 Nov 2019 01:27:28 -0800 From: "Steven Shi" To: devel@edk2.groups.io Cc: liming.gao@intel.com, bob.c.feng@intel.com, Steven Subject: [PATCH 0/4] BaseTools: Leverage compiler output dependency files for binary cache Date: Tue, 19 Nov 2019 17:26:57 +0800 Message-Id: <20191119092701.22988-1-steven.shi@intel.com> X-Mailer: git-send-email 2.17.1.windows.2 From: Steven BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=2353 This patch set is NOT for 201911 stable tag This patch is based on patch set: https://edk2.groups.io/g/devel/message/50360 You can directly try this patch set in this branch: https://github.com/shijunjing/edk2/tree/incrmtl_fix_v6 A previous patch set (https://edk2.groups.io/g/devel/message/50360) enhances Incremental Build, which is to use c preprocessor and trim tool to generate dependency files for the source file. This patch set is enhance the binary cache to follow the new method of dependency files generation through compiler, and redesign the binary cache intermediate meta files format. Shi, Steven (2): BaseTools: store more complete output files in binary cache BaseTools: enhance the CacheCopyFile method arg names BaseTools: Leverage compiler output to optimize binary cache BaseTools: Remove redundant binary cache file BaseTools/Source/Python/AutoGen/AutoGenWorker.py | 77 +- BaseTools/Source/Python/AutoGen/CacheIR.py | 29 - BaseTools/Source/Python/AutoGen/DataPipe.py | 2 + BaseTools/Source/Python/AutoGen/ModuleAutoGen.py | 1108 +++++++++----------- .../Source/Python/AutoGen/WorkspaceAutoGen.py | 64 +- BaseTools/Source/Python/Common/GlobalData.py | 35 +- BaseTools/Source/Python/build/build.py | 276 +++-- 7 files changed, 721 insertions(+), 870 deletions(-) delete mode 100755 BaseTools/Source/Python/AutoGen/CacheIR.py -- 2.16.1.windows.4