From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ml01.01.org (Postfix) with ESMTPS id 34BB580297 for ; Thu, 16 Mar 2017 11:51:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=intel.com; i=@intel.com; q=dns/txt; s=intel; t=1489690270; x=1521226270; h=mime-version:content-transfer-encoding:to:message-id: from:in-reply-to:references:subject:date; bh=2/CtLTYoMSxgMltgZLj+cVOchKj2R+ezDWUTLw6niQM=; b=gcjrclqC4DK8M0TdMhMZTsHLeAysMiHJRMiTb4xOZ4D4aQARzKu+Fc8+ ytTXvSkfyBFHuaKDXnfFHSYPdnBuQw==; Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by orsmga103.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 16 Mar 2017 11:51:09 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.36,173,1486454400"; d="scan'208";a="1123708195" Received: from jljusten-skl.jf.intel.com (HELO localhost) ([10.54.75.22]) by fmsmga001.fm.intel.com with ESMTP; 16 Mar 2017 11:51:09 -0700 MIME-Version: 1.0 To: Laszlo Ersek , edk2-devel-01 Message-ID: <148969026858.27582.5519307275216644796@jljusten-skl.jf.intel.com> From: Jordan Justen In-Reply-To: <20170314233246.17864-1-lersek@redhat.com> References: <20170314233246.17864-1-lersek@redhat.com> User-Agent: alot/0.5.1 Date: Thu, 16 Mar 2017 11:51:08 -0700 Subject: Re: [PATCH 00/14] OvmfPkg: add the Variable PEIM, defragment the UEFI memmap X-BeenThere: edk2-devel@lists.01.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: EDK II Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Mar 2017 18:51:10 -0000 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 2017-03-14 16:32:32, Laszlo Ersek wrote: > This series implements the ideas discussed in the thread > = > [edk2] memory type information HOB / UEFI memmap defrag > https://lists.01.org/pipermail/edk2-devel/2017-February/007576.html > = > I'm seeing good results, with approx. 20-24 UEFI memmap entries removed. > = > The benefits of the patch set are automatically enabled for SMM_REQUIRE > builds. > = > For non-SMM builds (which are the default), another build flag is being > introduced, namely MEM_VARSTORE_EMU_ENABLE. This build flag controls the > reserved memory / NvVars file based variable emulation. It remains > enabled by default (keeping the current status quo). For benefiting from > the Variable PEIM and the dependent UEFI memmap defragmentation, > MEM_VARSTORE_EMU_ENABLE has to be *disabled*. There are two reasons for > this: > = > - The PEI phase FTW and Variable modules need immediate (at-startup) > access to the variable store, but the reserved memory based emulation > depends on dynamic allocation, plus moving the dynamic pflash > detection to PEI is out of question. > = > - Even more importantly, reading actual variable contents from the > non-pflash varstore would require, in PEI, similar hackery that > currently happens in BDS -- that's not going to happen. What prevents us from enabling the PEI variable stack running using the memory based "emu fvb"? > In fact one of the longer term goals with MEM_VARSTORE_EMU_ENABLE is to > identify what we'll rip out once we finally decide to drop the reserved > memory / NvVars file based emulation. I think what we could consider ripping out is the disk save feature. Since QEMU/KVM (at least in the past) seem to preserve RAM contents across reboot, I think the memory based buffers should continue to be a fallback for when users don't get pflash setup correctly. That said, I'm not sure we should decide to rip out the disk save feature just yet, unless you think it can simplify things greatly. -Jordan > A summary of build modes: > = > * default build: works as before, with the Variable PEIM and UEFI memmap > defragmentation remaining unavailable. > = > * -D SMM_REQUIRE: works as before, with the Variable PEIM and UEFI > memmap defragmentation enabled. > = > As a reminder, this build is inherently incompatible with QEMU's > "-bios" and "-L" parameters, which will trigger the ASSERT() in > QemuFlashInitialize() > [OvmfPkg/QemuFlashFvbServicesRuntimeDxe/QemuFlash.c], added in commit > b963ec494c48 ("OvmfPkg: QemuFlashFvbServicesRuntimeDxe: adhere to -D > SMM_REQUIRE", 2015-11-30). > = > * -D MEM_VARSTORE_EMU_ENABLE=3DFALSE: eliminates the reserved memory / > NvVars based variable emulation, turns pflash into a hard requirement, > and enables the Variable PEIM and the UEFI memmap defragmentation. > = > If such a build is executed with -bios or -L, then the FTW and > Variable PEIMs will temporarily see a well-formed, but empty varstore > (straight from "OvmfPkg/VarStore.fdf.inc"), and then > QemuFlashFvbServicesRuntimeDxe will trip a new ASSERT(), in patch #6, > that is similar to the one added in commit b963ec494c48 (see above). > = > Anatomy of the series: > = > * Patches 01 through 04 clean up some innocent warts I noticed while > working on the feature. > = > * Patches 05 through 07 introduce the new build option and its basic > effect, the disabling of reserved memory based variable emulation. > = > * Patches 08 through 12 include the FTW and Variable PEIMs. > = > * Patch 13 enables UEFI memmap defragmentation. > = > * Patch 14 updates the README file. > = > The variable PEIM was independently requested in > earlier, but > without a good upstreamable use case, I disagreed with its inclusion. > The memmap defragmentation is a good use case however. > = > Also, I didn't lie about "downstream pressure" in my previous patch set; > I wrote this one at Sunday/Monday night (and now it's Tues/Wed night). > So one could consider this personal diligence. :) > = > The series conforms to the multi-line function call syntax outlined in > . > = > Repo: https://github.com/lersek/edk2.git > Branch: memmap_defrag > = > CC: Jordan Justen > = > Thanks > Laszlo > = > Laszlo Ersek (14): > OvmfPkg/EmuVariableFvbRuntimeDxe: always format an auth varstore > header > OvmfPkg: remove gUefiOvmfPkgTokenSpaceGuid.PcdSecureBootEnable > OvmfPkg/PlatformPei: remove unused PcdVariableStoreSize dependency > OvmfPkg/PlatformPei: don't allocate reserved mem varstore if > SMM_REQUIRE > OvmfPkg: introduce PcdMemVarstoreEmuEnable feature flag > OvmfPkg/QemuFlashFvbServicesRuntimeDxe: check PcdMemVarstoreEmuEnable > OvmfPkg: conditionally disable reserved memory varstore emulation at > build > OvmfPkg: resolve PcdLib for all PEIMs individually > OvmfPkg: resolve PcdLib for PEIMs to PeiPcdLib by default > OvmfPkg: introduce FlashNvStorageAddressLib > OvmfPkg: include FaultTolerantWritePei and VariablePei > OvmfPkg/QemuFlashFvbServicesRuntimeDxe: don't set flash PCDs if SMM or > no-emu > OvmfPkg/PlatformPei: remedy UEFI memory map fragmentation > OvmfPkg/README: document MEM_VARSTORE_EMU_ENABLE and memmap defrag > = > OvmfPkg/EmuVariableFvbRuntimeDxe/Fvb.c | = 79 +--------- > OvmfPkg/EmuVariableFvbRuntimeDxe/Fvb.inf | = 3 - > OvmfPkg/Library/FlashNvStorageAddressLib/FlashNvStorageAddressLib.c | = 53 +++++++ > OvmfPkg/Library/FlashNvStorageAddressLib/FlashNvStorageAddressLib.inf | = 48 +++++++ > OvmfPkg/OvmfPkg.dec | = 7 +- > OvmfPkg/OvmfPkgIa32.dsc | = 43 +++--- > OvmfPkg/OvmfPkgIa32.fdf | = 8 +- > OvmfPkg/OvmfPkgIa32X64.dsc | = 43 +++--- > OvmfPkg/OvmfPkgIa32X64.fdf | = 8 +- > OvmfPkg/OvmfPkgX64.dsc | = 43 +++--- > OvmfPkg/OvmfPkgX64.fdf | = 8 +- > OvmfPkg/PlatformPei/MemTypeInfo.c | = 151 ++++++++++++++++++++ > OvmfPkg/PlatformPei/Platform.c | = 28 +--- > OvmfPkg/PlatformPei/Platform.h | = 5 + > OvmfPkg/PlatformPei/PlatformPei.inf | = 4 +- > OvmfPkg/QemuFlashFvbServicesRuntimeDxe/FvbServicesRuntimeDxe.inf | = 1 + > OvmfPkg/QemuFlashFvbServicesRuntimeDxe/FvbServicesSmm.inf | = 1 + > OvmfPkg/QemuFlashFvbServicesRuntimeDxe/FwBlockService.c | = 58 +++++--- > OvmfPkg/QemuFlashFvbServicesRuntimeDxe/QemuFlash.c | = 1 + > OvmfPkg/README | = 10 ++ > 20 files changed, 425 insertions(+), 177 deletions(-) > create mode 100644 OvmfPkg/Library/FlashNvStorageAddressLib/FlashNvStora= geAddressLib.inf > create mode 100644 OvmfPkg/Library/FlashNvStorageAddressLib/FlashNvStora= geAddressLib.c > create mode 100644 OvmfPkg/PlatformPei/MemTypeInfo.c > = > -- = > 2.9.3 >=20