From mboxrd@z Thu Jan  1 00:00:00 1970
Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124])
 by mx.groups.io with SMTP id smtpd.web10.12094.1675336175524210420
 for <devel@edk2.groups.io>;
 Thu, 02 Feb 2023 03:09:36 -0800
Authentication-Results: mx.groups.io;
 dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=DJOcfjjp;
 spf=pass (domain: redhat.com, ip: 170.10.129.124, mailfrom: osteffen@redhat.com)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;
	s=mimecast20190719; t=1675336174;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=BUQ0LrWIRA0gmQS3EaP/qd+4EVh0xESf5WqS7p7dGUM=;
	b=DJOcfjjpgn+bJFKRNtoCPLxkPV8GX8WXSTkhNtnlX+YIw11mM0a8012rs134mhdZMREgBa
	ZKUxDhtntlvKrCq3dayMt+3SJqfsxGxjMBTy90JnxREyo3Q5OCtfmQOzaYfwCR0nfNT55B
	AVrScutbXI4vblTQlwzKJggTvIRxbTo=
Received: from mail-lf1-f71.google.com (mail-lf1-f71.google.com
 [209.85.167.71]) by relay.mimecast.com with ESMTP with STARTTLS
 (version=TLSv1.3, cipher=TLS_AES_128_GCM_SHA256) id
 us-mta-375-HjEG7tp8PR-Z86NcxzOykg-1; Thu, 02 Feb 2023 06:09:33 -0500
X-MC-Unique: HjEG7tp8PR-Z86NcxzOykg-1
Received: by mail-lf1-f71.google.com with SMTP id o16-20020ac24950000000b004d5811430c3so755803lfi.7
        for <devel@edk2.groups.io>; Thu, 02 Feb 2023 03:09:32 -0800 (PST)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20210112;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=BUQ0LrWIRA0gmQS3EaP/qd+4EVh0xESf5WqS7p7dGUM=;
        b=6CpuRowS3/KSb+FuIkFG7FB2ZIJiBgHvXnWYDu6fXPwhzhmhiFoPdf0Q2K046/wT3I
         1cluUAoqHe2qbj4HD4Rg+SUkzl7PHHnJXaZ0lt3fkfkvgFx30QQKfAqvVEkkGsci6Z3i
         p73QrPeW5dh7aw0fscC2xD6JFpCphxdng9S67jrZ9DSrZIOkwagIJGfW06tatRGokCGm
         AKR4ML/YYoT2UKTX6vS1rX02MJ2Zb3iDecP1U23OEG82pMvaUmBe3RY1K7XlWgBF+7YE
         OCfRjnwGRKuVcf5hEaCsCYQtifb/yUfZnYQlr2jTKBHv7E+PxG8MStIhWLV38XGeGAhG
         oglw==
X-Gm-Message-State: AO0yUKX3q5/s0LEBXyU5luN17rJmQ71lE0JDJJr7WJXkPEUIabpocGVB
	lUs/b4w8x7DvAcxRGMyoPKRMQDZyHjF7TjTSBj4aihNJ03pfCXVXhWoC4gEOeKZKs98zlQhcJGc
	c7Jsq9D+bh9viL/VffvjikaiUOqcLzA==
X-Received: by 2002:a2e:9e95:0:b0:290:6599:cf9 with SMTP id f21-20020a2e9e95000000b0029065990cf9mr1134731ljk.1.1675336170345;
        Thu, 02 Feb 2023 03:09:30 -0800 (PST)
X-Google-Smtp-Source: AK7set+JT0SVefbRaJDt1qzIsCmBbnpOe2rZIb/mkb2k+pXSHBqcnMNUjfG04i4wciwM1bAS1WPkxk5jsmRhDbj4spQ=
X-Received: by 2002:a2e:9e95:0:b0:290:6599:cf9 with SMTP id
 f21-20020a2e9e95000000b0029065990cf9mr1134727ljk.1.1675336169998; Thu, 02 Feb
 2023 03:09:29 -0800 (PST)
MIME-Version: 1.0
References: <Y7yshC6ZQNorwAwS@xps13.dannf> <CAMj1kXGhaAW1h-2kbaC2jpd+a4SzamT2f39LLVnoZjFg40Z5kw@mail.gmail.com>
 <CA+bRGFqTTUX9M9c-k91v1LNWJHqwGcHq_03WrKba_2rSDvmU3Q@mail.gmail.com>
 <CAMj1kXEyqRpKCum67O07AXq5FHD4OZCPy9Ph8TH7PZvywN_xhQ@mail.gmail.com>
 <CA+bRGFpQ_GPTHoCHA-E80B2tiuE3J7RojFwXWLryh+Q9wrtBtQ@mail.gmail.com>
 <CAMj1kXEDL2ZKYdTMruUwaAo-+YkYEOZXvxCAprB7JaB0Ms6wMg@mail.gmail.com>
 <CAMj1kXHiBAxvNZORVNK9kezTGBCMdKY6hQFks1wiWYPy8kWPGA@mail.gmail.com>
 <CA+bRGFqUMREGHWqVy6dhho+=t=ZSEa2xhhOSZF1UkMnfdR63Gg@mail.gmail.com>
 <CAMj1kXGm791TCP4mtkf22JVdbA9rEEkpTh=8HsAszt_sGK+V+g@mail.gmail.com>
 <20230119120021.4yohqindvj3ghwky@sirius.home.kraxel.org> <CA+bRGFqz2i_Y=V3mtrYhYtGJMQ0jtQ9rpBysGVHwki1j2RfVjQ@mail.gmail.com>
 <CAMj1kXFbAiQTFN6hG8BqRgDyU8wyOXpQs5PdQV3scNVS0gp9Gw@mail.gmail.com>
 <CA+bRGFqW2z8R6836qaUmeiK0r=8Z14=7nNSWk4ivWo6_BFAkxQ@mail.gmail.com>
 <CAMj1kXFGwK845fyAxexZY-QdRxYYXKzU8t2GDvtd2ZVQ=JCdeg@mail.gmail.com>
 <CA+bRGFqSOYQkoZUnLCEdnJM3np+m5kP1EDqcx6LOOXvhBNrg_A@mail.gmail.com> <CAMj1kXGkmudbkUnRnLkOmBecSSDKNJQpcs5Kn3oErA48ooPEyg@mail.gmail.com>
In-Reply-To: <CAMj1kXGkmudbkUnRnLkOmBecSSDKNJQpcs5Kn3oErA48ooPEyg@mail.gmail.com>
From: "Oliver Steffen" <osteffen@redhat.com>
Date: Thu, 2 Feb 2023 12:09:18 +0100
Message-ID: <CA+bRGFqL6-E9-Z_BHYhfi+ZOx03P5sajzxdt6icwB7vOVZkN9Q@mail.gmail.com>
Subject: Re: [edk2-devel] [PATCH v2 2/2] ArmVirtPkg/ArmVirtQemu: Avoid early ID map on ThunderX
To: Ard Biesheuvel <ardb@kernel.org>
Cc: devel@edk2.groups.io, Gerd Hoffmann <kraxel@redhat.com>, Marc Zyngier <maz@kernel.org>, 
	dann.frazier@canonical.com
X-Mimecast-Spam-Score: 0
X-Mimecast-Originator: redhat.com
Content-Type: multipart/alternative; boundary="0000000000004add6e05f3b59990"

--0000000000004add6e05f3b59990
Content-Type: text/plain; charset="UTF-8"

On Wed, Feb 1, 2023 at 2:29 PM Ard Biesheuvel <ardb@kernel.org> wrote:

> On Wed, 1 Feb 2023 at 13:59, Oliver Steffen <osteffen@redhat.com> wrote:
> >
> > On Wed, Feb 1, 2023 at 12:52 PM Ard Biesheuvel <ardb@kernel.org> wrote:
> >>
> >> On Wed, 1 Feb 2023 at 10:14, Oliver Steffen <osteffen@redhat.com>
> wrote:
> >> >
>
[...]

> >> > I am sorry, this story does not seem to be over yet.
> >> >
> >> > We are using the Erratum patch and also included the commit 406504c7
> in
> >> > the kernel.
> >> > Now the firmware crashes sometimes (10 out of 89 tests).
> >> >
> >>
> >> Thanks for the report. Is this still on ThunderX2?
> >>
> >> > Any hints are very welcome!
> >> >
> >>
> >> Do  you have access to those build artifacts?
> >
> >
> >
> https://kojihub.stream.centos.org/kojifiles/work/tasks/5251/1835251/edk2-aarch64-20221207gitfff6d81270b5-4.el9.test.noarch.rpm
> >
> > and/or here:
> >
> > https://kojihub.stream.centos.org/koji/taskinfo?taskID=1835251
> >
> > Source for reference:
> > https://gitlab.com/redhat/centos-stream/src/edk2/-/merge_requests/24
> >
>
> Any chance the .dll files (which are actually ELF executables) have
> been preserved somewhere?
>
Here is the build folder (~90MB):
https://gitlab.com/osteffen/thunderx2-debug/-/raw/main/armvirt-thunderx2-issue.tar.xz

I am waiting for the tests with the additional debug output to run.


> >> Can you share more of the log output?
> >> If you can rebuild, can you run it with DEBUG_VERBOSE set on ArmCpuDxe.
> E.g.,
> >>
> >> --- a/ArmVirtPkg/ArmVirtQemu.dsc
> >> +++ b/ArmVirtPkg/ArmVirtQemu.dsc
> >> @@ -383,7 +383,11 @@ [Components.common]
> >>    #
> >>    # Architectural Protocols
> >>    #
> >> -  ArmPkg/Drivers/CpuDxe/CpuDxe.inf
> >> +  ArmPkg/Drivers/CpuDxe/CpuDxe.inf {
> >> +    <PcdsFixedAtBuild>
> >> +      gEfiMdePkgTokenSpaceGuid.PcdDebugPrintErrorLevel|0x8040004F
> >> +  }
> >> +
> >>    MdeModulePkg/Core/RuntimeDxe/RuntimeDxe.inf
> >>    MdeModulePkg/Universal/Variable/RuntimeDxe/VariableRuntimeDxe.inf {
> >>      <LibraryClasses>
> >
> > I'll try to do that.
> >
> >
> >>
> >> > Here is the serial output of one case:
> >> > ----------------------------------------------------------------
> >> > UEFI firmware (version edk2-20221207gitfff6d81270b5-4.el9.test built
> at 00:00:00 on Jan 18 2023)
> >> > SyncPcrAllocationsAndPcrMask!
> >> >
> >> >
> >> > Synchronous Exception at 0x000000037FD5BDE0
> >> > PC 0x00037FD5BDE0 (0x00037FD59000+0x00002DE0) [ 0] ArmCpuDxe.dll
> >> > PC 0x00037FD5BDE0 (0x00037FD59000+0x00002DE0) [ 0] ArmCpuDxe.dll
> >> > PC 0x00037FD5BCE0 (0x00037FD59000+0x00002CE0) [ 0] ArmCpuDxe.dll
> >>
> >> This, along with
> >>
> >> >   SP 0x00000000476ED840  ELR 0x000000037FD5BDE0  SPSR 0x80000205
> FPSR 0x00000000
> >> >  ESR 0x86000005          FAR 0x000000037FD5BDE0
> >>
> >> taken from below suggests that UpdateRegionMappingRecursive () is
> >> unmapping itself, likely when splitting a block entry.
> >>
> >> This affects all ARM builds, not just ArmVIrtQemu so I would like to
> >> get to the bottom of this.
> >>
> >>
> >> Thanks,
> >> Ard.
> >>
> >>
> >>
> >> > PC 0x00037FD5C054 (0x00037FD59000+0x00003054) [ 0] ArmCpuDxe.dll
> >> > PC 0x0000476F08EC (0x0000476EE000+0x000028EC) [ 1] DxeCore.dll
> >> > PC 0x0000476F65C0 (0x0000476EE000+0x000085C0) [ 1] DxeCore.dll
> >> > PC 0x0000476FB5B8 (0x0000476EE000+0x0000D5B8) [ 1] DxeCore.dll
> >> > PC 0x0000476F5DB8 (0x0000476EE000+0x00007DB8) [ 1] DxeCore.dll
> >> > PC 0x00037FD5CD50 (0x00037FD59000+0x00003D50) [ 2] ArmCpuDxe.dll
> >> > PC 0x0000476F5758 (0x0000476EE000+0x00007758) [ 3] DxeCore.dll
> >> > PC 0x000047702B18 (0x0000476EE000+0x00014B18) [ 3] DxeCore.dll
> >> > PC 0x0000476F8D70 (0x0000476EE000+0x0000AD70) [ 3] DxeCore.dll
> >> >
> >> > [ 0]
> /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQemu-AARCH64/DEBUG_GCC5/AARCH64/ArmPkg/Drivers/CpuDxe/CpuDxe/DEBUG/ArmCpuDxe.dll
> >> > [ 1]
> /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQemu-AARCH64/DEBUG_GCC5/AARCH64/MdeModulePkg/Core/Dxe/DxeMain/DEBUG/DxeCore.dll
> >> > [ 2]
> /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQemu-AARCH64/DEBUG_GCC5/AARCH64/ArmPkg/Drivers/CpuDxe/CpuDxe/DEBUG/ArmCpuDxe.dll
> >> > [ 3]
> /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQemu-AARCH64/DEBUG_GCC5/AARCH64/MdeModulePkg/Core/Dxe/DxeMain/DEBUG/DxeCore.dll
> >> >
> >> >   X0 0x0000000047FFE068   X1 0x000000037F179003   X2
> 0x0000000000340000   X3 0x0000000000000000
> >> >   X4 0x0000000000000200   X5 0x0000000000000004   X6
> 0x0060000000000000   X7 0xFF9F000000000F3F
> >> >   X8 0x000000037FFFF008   X9 0x0000000400000000  X10
> 0x000000037F177000  X11 0x000000037FA37FFF
> >> >  X12 0x0000000000000000  X13 0x0000000000000008  X14
> 0x0000000000000000  X15 0x0000000000000000
> >> >  X16 0x000000037FD5A208  X17 0x00000000007979D0  X18
> 0x0000000000000000  X19 0x0000000340000000
> >> >  X20 0x0000000000000001  X21 0x000000037F179003  X22
> 0x0000000047FFE000  X23 0x0000000000000068
> >> >  X24 0x000000003FFFFFFF  X25 0x000000037CAA0000  X26
> 0x0000000000000002  X27 0x000000037F179000
> >> >  X28 0x0000000047FFE068   FP 0x00000000476ED840   LR
> 0x000000037FD5BDE0
> >> >
> >> >   V0 0x0000000000000000 0000000000000000   V1 0x0000000000000000
> 0000000000000000
> >> >   V2 0x0000000000000000 0000000000000000   V3 0x0000000000000000
> 0000000000000000
> >> >   V4 0x0000000000000000 0000000000000000   V5 0x0000000000000000
> 0000000000000000
> >> >   V6 0x0000000000000000 0000000000000000   V7 0x0000000000000000
> 0000000000000000
> >> >   V8 0x0000000000000000 0000000000000000   V9 0x0000000000000000
> 0000000000000000
> >> >  V10 0x0000000000000000 0000000000000000  V11 0x0000000000000000
> 0000000000000000
> >> >  V12 0x0000000000000000 0000000000000000  V13 0x0000000000000000
> 0000000000000000
> >> >  V14 0x0000000000000000 0000000000000000  V15 0x0000000000000000
> 0000000000000000
> >> >  V16 0x0000000000000000 0000000000000000  V17 0x0000000000000000
> 0000000000000000
> >> >  V18 0x0000000000000000 0000000000000000  V19 0x0000000000000000
> 0000000000000000
> >> >  V20 0x0000000000000000 0000000000000000  V21 0x0000000000000000
> 0000000000000000
> >> >  V22 0x0000000000000000 0000000000000000  V23 0x0000000000000000
> 0000000000000000
> >> >  V24 0x0000000000000000 0000000000000000  V25 0x0000000000000000
> 0000000000000000
> >> >  V26 0x0000000000000000 0000000000000000  V27 0x0000000000000000
> 0000000000000000
> >> >  V28 0x0000000000000000 0000000000000000  V29 0x0000000000000000
> 0000000000000000
> >> >  V30 0x0000000000000000 0000000000000000  V31 0x0000000000000000
> 0000000000000000
> >> >
> >> >   SP 0x00000000476ED840  ELR 0x000000037FD5BDE0  SPSR 0x80000205
> FPSR 0x00000000
> >> >  ESR 0x86000005          FAR 0x000000037FD5BDE0
> >> >
> >> >  ESR : EC 0x21  IL 0x1  ISS 0x00000005
> >> >
> >> > Instruction abort: Translation fault, first level
> >> >
> >> > Stack dump:
> >> >   00000476ED740: 000000037CAA0000 000000037CAA0000 0060000000000000
> FF9F000000000F3F
> >> >   00000476ED760: 00000000476ED790 000000037FD610D8 0060000000000003
> 0000000C00000001
> >> >   00000476ED780: 000000037CA0070D 000000037F179000 00000000476ED840
> 000000037FD5BCE0
> >> >   00000476ED7A0: 0000000340000000 0000000000000001 000000037F179000
> 0000000047FFE000
> >> >   00000476ED7C0: 0000000000000068 000000003FFFFFFF 000000037CAA0000
> 0000000000000002
> >> >   00000476ED7E0: 000000037F179000 0000000047FFE068 000000037CC00000
> 000000037CAA0000
> >> >   00000476ED800: 0060000000000000 FF9F000000000F3F 00000000476ED840
> 000000037FD610D8
> >> >   00000476ED820: 0060000000000001 0000001500000001 000000034000070D
> 000000037F177000
> >> > > 00000476ED840: 00000000476ED8F0 000000037FD5BCE0 0000000047FFA000
> 0000000000000000
> >> >   00000476ED860: 0000000047FFE000 0000000047FFF000 0000000000000000
> 0000007FFFFFFFFF
> >> >   00000476ED880: 000000037CAA0000 0000000000000001 0000000047717588
> 0000000047FFF000
> >> >   00000476ED8A0: 0000000380000000 000000037CAA0000 0060000000000000
> FF9F000000000F3F
> >> >   00000476ED8C0: 000000017FD605DD 000000037FD610D8 0060000000000001
> 0000001E00000001
> >> >   00000476ED8E0: 0060000000000000 000000037F179000 00000000476ED9A0
> 000000037FD5C054
> >> >   00000476ED900: 002000000000041C 0000000000000000 0000000047FFA000
> 0000000000004000
> >> >   00000476ED920: 0000000334AA6000 0000000047FFF000 000000037F17A238
> 0000000047717000
> >> > ASSERT [ArmCpuDxe]
> /builddir/build/BUILD/edk2-fff6d81270b5/ArmPkg/Library/DefaultExceptionHandlerLib/AArch64/DefaultExceptionHandler.c(333):
> ((BOOLEAN)(0==1))
> >> > ----------------------------------------------------------------
> >> > Thanks,
> >> >  Oliver
> >> >
>
>

--0000000000004add6e05f3b59990
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div class=3D"gmail_default" style=3D"fon=
t-size:small"><br></div></div><div dir=3D"ltr"><div class=3D"gmail_quote"><=
div dir=3D"ltr" class=3D"gmail_attr">On Wed, Feb 1, 2023 at 2:29 PM Ard Bie=
sheuvel &lt;<a href=3D"mailto:ardb@kernel.org" target=3D"_blank">ardb@kerne=
l.org</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"ma=
rgin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:=
1ex">On Wed, 1 Feb 2023 at 13:59, Oliver Steffen &lt;<a href=3D"mailto:oste=
ffen@redhat.com" target=3D"_blank">osteffen@redhat.com</a>&gt; wrote:<br>
&gt;<br>
&gt; On Wed, Feb 1, 2023 at 12:52 PM Ard Biesheuvel &lt;<a href=3D"mailto:a=
rdb@kernel.org" target=3D"_blank">ardb@kernel.org</a>&gt; wrote:<br>
&gt;&gt;<br>
&gt;&gt; On Wed, 1 Feb 2023 at 10:14, Oliver Steffen &lt;<a href=3D"mailto:=
osteffen@redhat.com" target=3D"_blank">osteffen@redhat.com</a>&gt; wrote:<b=
r>
&gt;&gt; &gt;<br></blockquote><div><span class=3D"gmail_default" style=3D"f=
ont-size:small">[...]</span>=C2=A0</div><blockquote class=3D"gmail_quote" s=
tyle=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);pad=
ding-left:1ex">
&gt;&gt; &gt; I am sorry, this story does not seem to be over yet.<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; We are using the Erratum patch and also included the commit 4=
06504c7 in<br>
&gt;&gt; &gt; the kernel.<br>
&gt;&gt; &gt; Now the firmware crashes sometimes (10 out of 89 tests).<br>
&gt;&gt; &gt;<br>
&gt;&gt;<br>
&gt;&gt; Thanks for the report. Is this still on ThunderX2?<br>
&gt;&gt;<br>
&gt;&gt; &gt; Any hints are very welcome!<br>
&gt;&gt; &gt;<br>
&gt;&gt;<br>
&gt;&gt; Do=C2=A0 you have access to those build artifacts?<br>
&gt;<br>
&gt;<br>
&gt; <a href=3D"https://kojihub.stream.centos.org/kojifiles/work/tasks/5251=
/1835251/edk2-aarch64-20221207gitfff6d81270b5-4.el9.test.noarch.rpm" rel=3D=
"noreferrer" target=3D"_blank">https://kojihub.stream.centos.org/kojifiles/=
work/tasks/5251/1835251/edk2-aarch64-20221207gitfff6d81270b5-4.el9.test.noa=
rch.rpm</a><br>
&gt;<br>
&gt; and/or here:<br>
&gt;<br>
&gt; <a href=3D"https://kojihub.stream.centos.org/koji/taskinfo?taskID=3D18=
35251" rel=3D"noreferrer" target=3D"_blank">https://kojihub.stream.centos.o=
rg/koji/taskinfo?taskID=3D1835251</a><br>
&gt;<br>
&gt; Source for reference:<br>
&gt; <a href=3D"https://gitlab.com/redhat/centos-stream/src/edk2/-/merge_re=
quests/24" rel=3D"noreferrer" target=3D"_blank">https://gitlab.com/redhat/c=
entos-stream/src/edk2/-/merge_requests/24</a><br>
&gt;<br>
<br>
Any chance the .dll files (which are actually ELF executables) have<br>
been preserved somewhere?<br></blockquote><div><div style=3D"font-size:smal=
l" class=3D"gmail_default"></div><div style=3D"font-size:small" class=3D"gm=
ail_default">Here is the build folder (~90MB):<br></div><div style=3D"font-=
size:small" class=3D"gmail_default"><a href=3D"https://gitlab.com/osteffen/=
thunderx2-debug/-/raw/main/armvirt-thunderx2-issue.tar.xz">https://gitlab.c=
om/osteffen/thunderx2-debug/-/raw/main/armvirt-thunderx2-issue.tar.xz</a></=
div></div><div><br></div><div><div style=3D"font-size:small" class=3D"gmail=
_default">I am waiting for the tests with the additional debug output to ru=
n.<br></div></div><div>=C2=A0</div><blockquote class=3D"gmail_quote" style=
=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding=
-left:1ex">
&gt;&gt; Can you share more of the log output?<br>
&gt;&gt; If you can rebuild, can you run it with DEBUG_VERBOSE set on ArmCp=
uDxe. E.g.,<br>
&gt;&gt;<br>
&gt;&gt; --- a/ArmVirtPkg/ArmVirtQemu.dsc<br>
&gt;&gt; +++ b/ArmVirtPkg/ArmVirtQemu.dsc<br>
&gt;&gt; @@ -383,7 +383,11 @@ [Components.common]<br>
&gt;&gt;=C2=A0 =C2=A0 #<br>
&gt;&gt;=C2=A0 =C2=A0 # Architectural Protocols<br>
&gt;&gt;=C2=A0 =C2=A0 #<br>
&gt;&gt; -=C2=A0 ArmPkg/Drivers/CpuDxe/CpuDxe.inf<br>
&gt;&gt; +=C2=A0 ArmPkg/Drivers/CpuDxe/CpuDxe.inf {<br>
&gt;&gt; +=C2=A0 =C2=A0 &lt;PcdsFixedAtBuild&gt;<br>
&gt;&gt; +=C2=A0 =C2=A0 =C2=A0 gEfiMdePkgTokenSpaceGuid.PcdDebugPrintErrorL=
evel|0x8040004F<br>
&gt;&gt; +=C2=A0 }<br>
&gt;&gt; +<br>
&gt;&gt;=C2=A0 =C2=A0 MdeModulePkg/Core/RuntimeDxe/RuntimeDxe.inf<br>
&gt;&gt;=C2=A0 =C2=A0 MdeModulePkg/Universal/Variable/RuntimeDxe/VariableRu=
ntimeDxe.inf {<br>
&gt;&gt;=C2=A0 =C2=A0 =C2=A0 &lt;LibraryClasses&gt;<br>
&gt;<br>
&gt; I&#39;ll try to do that.<br>
&gt;<br>
&gt;<br>
&gt;&gt;<br>
&gt;&gt; &gt; Here is the serial output of one case:<br>
&gt;&gt; &gt; -------------------------------------------------------------=
---<br>
&gt;&gt; &gt; UEFI firmware (version edk2-20221207gitfff6d81270b5-4.el9.tes=
t built at 00:00:00 on Jan 18 2023)<br>
&gt;&gt; &gt; SyncPcrAllocationsAndPcrMask!<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; Synchronous Exception at 0x000000037FD5BDE0<br>
&gt;&gt; &gt; PC 0x00037FD5BDE0 (0x00037FD59000+0x00002DE0) [ 0] ArmCpuDxe.=
dll<br>
&gt;&gt; &gt; PC 0x00037FD5BDE0 (0x00037FD59000+0x00002DE0) [ 0] ArmCpuDxe.=
dll<br>
&gt;&gt; &gt; PC 0x00037FD5BCE0 (0x00037FD59000+0x00002CE0) [ 0] ArmCpuDxe.=
dll<br>
&gt;&gt;<br>
&gt;&gt; This, along with<br>
&gt;&gt;<br>
&gt;&gt; &gt;=C2=A0 =C2=A0SP 0x00000000476ED840=C2=A0 ELR 0x000000037FD5BDE=
0=C2=A0 SPSR 0x80000205=C2=A0 FPSR 0x00000000<br>
&gt;&gt; &gt;=C2=A0 ESR 0x86000005=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 FAR 0x=
000000037FD5BDE0<br>
&gt;&gt;<br>
&gt;&gt; taken from below suggests that UpdateRegionMappingRecursive () is<=
br>
&gt;&gt; unmapping itself, likely when splitting a block entry.<br>
&gt;&gt;<br>
&gt;&gt; This affects all ARM builds, not just ArmVIrtQemu so I would like =
to<br>
&gt;&gt; get to the bottom of this.<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt; Thanks,<br>
&gt;&gt; Ard.<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt; &gt; PC 0x00037FD5C054 (0x00037FD59000+0x00003054) [ 0] ArmCpuDxe.=
dll<br>
&gt;&gt; &gt; PC 0x0000476F08EC (0x0000476EE000+0x000028EC) [ 1] DxeCore.dl=
l<br>
&gt;&gt; &gt; PC 0x0000476F65C0 (0x0000476EE000+0x000085C0) [ 1] DxeCore.dl=
l<br>
&gt;&gt; &gt; PC 0x0000476FB5B8 (0x0000476EE000+0x0000D5B8) [ 1] DxeCore.dl=
l<br>
&gt;&gt; &gt; PC 0x0000476F5DB8 (0x0000476EE000+0x00007DB8) [ 1] DxeCore.dl=
l<br>
&gt;&gt; &gt; PC 0x00037FD5CD50 (0x00037FD59000+0x00003D50) [ 2] ArmCpuDxe.=
dll<br>
&gt;&gt; &gt; PC 0x0000476F5758 (0x0000476EE000+0x00007758) [ 3] DxeCore.dl=
l<br>
&gt;&gt; &gt; PC 0x000047702B18 (0x0000476EE000+0x00014B18) [ 3] DxeCore.dl=
l<br>
&gt;&gt; &gt; PC 0x0000476F8D70 (0x0000476EE000+0x0000AD70) [ 3] DxeCore.dl=
l<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; [ 0] /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQem=
u-AARCH64/DEBUG_GCC5/AARCH64/ArmPkg/Drivers/CpuDxe/CpuDxe/DEBUG/ArmCpuDxe.d=
ll<br>
&gt;&gt; &gt; [ 1] /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQem=
u-AARCH64/DEBUG_GCC5/AARCH64/MdeModulePkg/Core/Dxe/DxeMain/DEBUG/DxeCore.dl=
l<br>
&gt;&gt; &gt; [ 2] /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQem=
u-AARCH64/DEBUG_GCC5/AARCH64/ArmPkg/Drivers/CpuDxe/CpuDxe/DEBUG/ArmCpuDxe.d=
ll<br>
&gt;&gt; &gt; [ 3] /builddir/build/BUILD/edk2-fff6d81270b5/Build/ArmVirtQem=
u-AARCH64/DEBUG_GCC5/AARCH64/MdeModulePkg/Core/Dxe/DxeMain/DEBUG/DxeCore.dl=
l<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt;=C2=A0 =C2=A0X0 0x0000000047FFE068=C2=A0 =C2=A0X1 0x000000037F=
179003=C2=A0 =C2=A0X2 0x0000000000340000=C2=A0 =C2=A0X3 0x0000000000000000<=
br>
&gt;&gt; &gt;=C2=A0 =C2=A0X4 0x0000000000000200=C2=A0 =C2=A0X5 0x0000000000=
000004=C2=A0 =C2=A0X6 0x0060000000000000=C2=A0 =C2=A0X7 0xFF9F000000000F3F<=
br>
&gt;&gt; &gt;=C2=A0 =C2=A0X8 0x000000037FFFF008=C2=A0 =C2=A0X9 0x0000000400=
000000=C2=A0 X10 0x000000037F177000=C2=A0 X11 0x000000037FA37FFF<br>
&gt;&gt; &gt;=C2=A0 X12 0x0000000000000000=C2=A0 X13 0x0000000000000008=C2=
=A0 X14 0x0000000000000000=C2=A0 X15 0x0000000000000000<br>
&gt;&gt; &gt;=C2=A0 X16 0x000000037FD5A208=C2=A0 X17 0x00000000007979D0=C2=
=A0 X18 0x0000000000000000=C2=A0 X19 0x0000000340000000<br>
&gt;&gt; &gt;=C2=A0 X20 0x0000000000000001=C2=A0 X21 0x000000037F179003=C2=
=A0 X22 0x0000000047FFE000=C2=A0 X23 0x0000000000000068<br>
&gt;&gt; &gt;=C2=A0 X24 0x000000003FFFFFFF=C2=A0 X25 0x000000037CAA0000=C2=
=A0 X26 0x0000000000000002=C2=A0 X27 0x000000037F179000<br>
&gt;&gt; &gt;=C2=A0 X28 0x0000000047FFE068=C2=A0 =C2=A0FP 0x00000000476ED84=
0=C2=A0 =C2=A0LR 0x000000037FD5BDE0<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt;=C2=A0 =C2=A0V0 0x0000000000000000 0000000000000000=C2=A0 =C2=
=A0V1 0x0000000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 =C2=A0V2 0x0000000000000000 0000000000000000=C2=A0 =C2=
=A0V3 0x0000000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 =C2=A0V4 0x0000000000000000 0000000000000000=C2=A0 =C2=
=A0V5 0x0000000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 =C2=A0V6 0x0000000000000000 0000000000000000=C2=A0 =C2=
=A0V7 0x0000000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 =C2=A0V8 0x0000000000000000 0000000000000000=C2=A0 =C2=
=A0V9 0x0000000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V10 0x0000000000000000 0000000000000000=C2=A0 V11 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V12 0x0000000000000000 0000000000000000=C2=A0 V13 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V14 0x0000000000000000 0000000000000000=C2=A0 V15 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V16 0x0000000000000000 0000000000000000=C2=A0 V17 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V18 0x0000000000000000 0000000000000000=C2=A0 V19 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V20 0x0000000000000000 0000000000000000=C2=A0 V21 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V22 0x0000000000000000 0000000000000000=C2=A0 V23 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V24 0x0000000000000000 0000000000000000=C2=A0 V25 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V26 0x0000000000000000 0000000000000000=C2=A0 V27 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V28 0x0000000000000000 0000000000000000=C2=A0 V29 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 V30 0x0000000000000000 0000000000000000=C2=A0 V31 0x000=
0000000000000 0000000000000000<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt;=C2=A0 =C2=A0SP 0x00000000476ED840=C2=A0 ELR 0x000000037FD5BDE=
0=C2=A0 SPSR 0x80000205=C2=A0 FPSR 0x00000000<br>
&gt;&gt; &gt;=C2=A0 ESR 0x86000005=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 FAR 0x=
000000037FD5BDE0<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt;=C2=A0 ESR : EC 0x21=C2=A0 IL 0x1=C2=A0 ISS 0x00000005<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; Instruction abort: Translation fault, first level<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; Stack dump:<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED740: 000000037CAA0000 000000037CAA0000 =
0060000000000000 FF9F000000000F3F<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED760: 00000000476ED790 000000037FD610D8 =
0060000000000003 0000000C00000001<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED780: 000000037CA0070D 000000037F179000 =
00000000476ED840 000000037FD5BCE0<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED7A0: 0000000340000000 0000000000000001 =
000000037F179000 0000000047FFE000<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED7C0: 0000000000000068 000000003FFFFFFF =
000000037CAA0000 0000000000000002<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED7E0: 000000037F179000 0000000047FFE068 =
000000037CC00000 000000037CAA0000<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED800: 0060000000000000 FF9F000000000F3F =
00000000476ED840 000000037FD610D8<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED820: 0060000000000001 0000001500000001 =
000000034000070D 000000037F177000<br>
&gt;&gt; &gt; &gt; 00000476ED840: 00000000476ED8F0 000000037FD5BCE0 0000000=
047FFA000 0000000000000000<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED860: 0000000047FFE000 0000000047FFF000 =
0000000000000000 0000007FFFFFFFFF<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED880: 000000037CAA0000 0000000000000001 =
0000000047717588 0000000047FFF000<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED8A0: 0000000380000000 000000037CAA0000 =
0060000000000000 FF9F000000000F3F<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED8C0: 000000017FD605DD 000000037FD610D8 =
0060000000000001 0000001E00000001<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED8E0: 0060000000000000 000000037F179000 =
00000000476ED9A0 000000037FD5C054<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED900: 002000000000041C 0000000000000000 =
0000000047FFA000 0000000000004000<br>
&gt;&gt; &gt;=C2=A0 =C2=A000000476ED920: 0000000334AA6000 0000000047FFF000 =
000000037F17A238 0000000047717000<br>
&gt;&gt; &gt; ASSERT [ArmCpuDxe] /builddir/build/BUILD/edk2-fff6d81270b5/Ar=
mPkg/Library/DefaultExceptionHandlerLib/AArch64/DefaultExceptionHandler.c(3=
33): ((BOOLEAN)(0=3D=3D1))<br>
&gt;&gt; &gt; -------------------------------------------------------------=
---<br>
&gt;&gt; &gt; Thanks,<br>
&gt;&gt; &gt;=C2=A0 Oliver<br>
&gt;&gt; &gt;<br><br>
</blockquote></div></div>
</div>

--0000000000004add6e05f3b59990--