From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail05.groups.io (mail05.groups.io [45.79.224.7]) by spool.mail.gandi.net (Postfix) with ESMTPS id 912D674003A for ; Wed, 4 Dec 2024 14:56:23 +0000 (UTC) DKIM-Signature: a=rsa-sha256; bh=pV+jy9KZWJA1/oRGKfYyGKjZ3ITmDCgqRUcn0EKPkrM=; c=relaxed/simple; d=groups.io; h=Subject:To:From:User-Agent:MIME-Version:Date:References:In-Reply-To:Message-ID:Precedence:List-Subscribe:List-Help:Sender:List-Id:Mailing-List:Delivered-To:Reply-To:List-Unsubscribe-Post:List-Unsubscribe:Content-Type; s=20240830; t=1733324183; v=1; x=1733583381; b=iR5+LNr9ohxR9TLoUBgg8QAH7PW3CcAwFnGIKjqlF+hImKQzSj8slMqY3PityfHnXFFqUaPF QYGY9KKd9OuhQYchysG1w0pMfeVMLQN1CAsXDM22cv6no9mISOnTzYMuf3auyDP89GMAqpXXRaI hHMv1x1XumKIbp8FxGpVz01yZeySWJ8+SGWwXwHqRipQAf/pPDEOMhP0Cut1E8rtzCZ/UQ1M95Q 0fxZFfcMS7OnK2LQjcYw9EGVni2hgMhRdBRhXUiW7CLumsW1aGs/LoAXRKgmpkaff/93ZpMOlnf 9/T/RVHzxC1C9SgoPCJf781GhyqdpKU3MOISOofMmXetQ== X-Received: by 127.0.0.2 with SMTP id xUT3YY7687511xnWaqn0efqu; Wed, 04 Dec 2024 06:56:21 -0800 Subject: Re: [edk2-devel] [BUG] Extremely slow boot times with CPU and GPU passthrough and host phys-bits > 40 To: mitchell.augustin@canonical.com, devel@edk2.groups.io From: "mitchell.augustin via groups.io" X-Originating-Location: Waterloo, Illinois, US (65.87.55.115) X-Originating-Platform: Linux Chrome 129 User-Agent: GROUPS.IO Web Poster MIME-Version: 1.0 Date: Wed, 04 Dec 2024 06:56:21 -0800 References: <2202.1732660048387996911@groups.io> In-Reply-To: <2202.1732660048387996911@groups.io> Message-ID: <20236.1733324181278436066@groups.io> Precedence: Bulk List-Subscribe: List-Help: Sender: devel@edk2.groups.io List-Id: Mailing-List: list devel@edk2.groups.io; contact devel+owner@edk2.groups.io Reply-To: devel@edk2.groups.io,mitchell.augustin@canonical.com List-Unsubscribe-Post: List-Unsubscribe=One-Click List-Unsubscribe: X-Gm-Message-State: OoRMMqbveqnaeeyrjmmftUdcx7686176AA= Content-Type: multipart/alternative; boundary="Ksf42f7c5ZXT5NM41vQe" X-GND-Status: LEGIT Authentication-Results: spool.mail.gandi.net; dkim=pass header.d=groups.io header.s=20240830 header.b=iR5+LNr9; dmarc=pass (policy=none) header.from=groups.io; spf=pass (spool.mail.gandi.net: domain of bounce@groups.io designates 45.79.224.7 as permitted sender) smtp.mailfrom=bounce@groups.io --Ksf42f7c5ZXT5NM41vQe Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable > What does 'sudo lspci -v' print for the NPU on the host and in the guest? Guest VM lspci -v output ( https://pastebin.ubuntu.com/p/8SV9qPBJbS/ ) Host lspci -v output ( https://pastebin.ubuntu.com/p/YV4RTZwGMv/ ) Here's one of the host GPUs: 1b:00.0 3D controller: NVIDIA Corporation GH100 [H100 SXM5 80GB] (rev a1) DeviceName: GPU0 Subsystem: NVIDIA Corporation GH100 [H100 SXM5 80GB] Flags: bus master, fast devsel, latency 0, IRQ 18, NUMA node 0, IOMMU group= 67 Memory at 21e042000000 (64-bit, prefetchable) [size=3D16M] Memory at 21a000000000 (64-bit, prefetchable) [size=3D128G] Memory at 21e040000000 (64-bit, prefetchable) [size=3D32M] Capabilities: Kernel driver in use: vfio-pci Kernel modules: nvidiafb And the same GPU as it appears on the guest: 06:00.0 3D controller: NVIDIA Corporation Device 2330 (rev a1) Subsystem: NVIDIA Corporation Device 16c1 Physical Slot: 0-6 Flags: bus master, fast devsel, latency 0, IRQ 10 Memory at 382002000000 (64-bit, prefetchable) [size=3D16M] Memory at 380000000000 (64-bit, prefetchable) [size=3D128G] Memory at 382000000000 (64-bit, prefetchable) [size=3D32M] Capabilities: Kernel modules: nvidiafb Also, regarding the root cause of the slowdown, we're making some good prog= ress in this thread ( https://lore.kernel.org/all/CAHTA-uYp07FgM6T1OZQKqAdS= A5JrZo0ReNEyZgQZub4mDRrV5w@.../ ). (it is increasingly seeming like more of= a kernel issue than an OVMF issue). - Mitchell Augustin -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- Groups.io Links: You receive all messages sent to this group. View/Reply Online (#120869): https://edk2.groups.io/g/devel/message/120869 Mute This Topic: https://groups.io/mt/109651206/7686176 Group Owner: devel+owner@edk2.groups.io Unsubscribe: https://edk2.groups.io/g/devel/unsub [rebecca@openfw.io] -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- --Ksf42f7c5ZXT5NM41vQe Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable
> What does 'sudo lspci -v' print for the NPU on the host and in th= e guest?
 
 
Here's one of the host GPUs:
1b:00.0 3D controller: NVIDIA Corporation GH100 [H100 SXM5 80GB] (rev = a1)
    DeviceName: GPU0
    Subsystem: NVIDI= A Corporation GH100 [H100 SXM5 80GB]
    Flags: bus master, = fast devsel, latency 0, IRQ 18, NUMA node 0, IOMMU group 67
  &nb= sp; Memory at 21e042000000 (64-bit, prefetchable) [size=3D16M]
  =   Memory at 21a000000000 (64-bit, prefetchable) [size=3D128G]
&nb= sp;   Memory at 21e040000000 (64-bit, prefetchable) [size=3D32M]
=     Capabilities: <access denied>
    Kernel= driver in use: vfio-pci
    Kernel modules: nvidiafb
 
And the same GPU as it appears on the guest:
06:00.0 3D controller: NVIDIA Corporation Device 2330 (rev a1)
&n= bsp;   Subsystem: NVIDIA Corporation Device 16c1
    Ph= ysical Slot: 0-6
    Flags: bus master, fast devsel, latency= 0, IRQ 10
    Memory at 382002000000 (64-bit, prefetchable)= [size=3D16M]
    Memory at 380000000000 (64-bit, prefetchab= le) [size=3D128G]
    Memory at 382000000000 (64-bit, prefet= chable) [size=3D32M]
    Capabilities: <access denied>=
    Kernel modules: nvidiafb
 
Also, regarding the root cause of the slowdown, we're making some good= progress in this = thread. (it is increasingly seeming like more of a kernel issue than an= OVMF issue).
 
- Mitchell Augustin
_._,_._,_
Groups.io Links:

=20 You receive all messages sent to this group. =20 =20

View/Reply Online (#120869) | =20 | Mute= This Topic | New Topic
Your Subscriptio= n | Contact Group Owner | Unsubscribe [rebecca@openfw.io]

_._,_._,_
--Ksf42f7c5ZXT5NM41vQe--