From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-1.mimecast.com (us-smtp-1.mimecast.com [207.211.31.120]) by mx.groups.io with SMTP id smtpd.web10.129738.1597994622542507503 for ; Fri, 21 Aug 2020 00:23:42 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=aDyViqZy; spf=pass (domain: redhat.com, ip: 207.211.31.120, mailfrom: lersek@redhat.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1597994621; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sfq48CPDjESDl1neYtl0AvIq8wVuEwpJd6Z9ECdshrY=; b=aDyViqZyxZEbfIZpPguMjxNwsi/EDp4b3zSuDlq11zqf/NA6KhHDgFArt1fOxXsbm+fyp5 zYQRAeFDC5cqREDDaher0fMNwRyRRhSoJ3DQqe3ecjxwcXZFBSjgdNrgFmbbil8zBIC+1K /nPUDGkf7CcJfKVyZN80teDejCMjl/g= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-159-C1t1hJCGOheC36N8ctknjg-1; Fri, 21 Aug 2020 03:23:37 -0400 X-MC-Unique: C1t1hJCGOheC36N8ctknjg-1 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id AAB1C8030D0; Fri, 21 Aug 2020 07:23:35 +0000 (UTC) Received: from lacos-laptop-7.usersys.redhat.com (ovpn-113-164.ams2.redhat.com [10.36.113.164]) by smtp.corp.redhat.com (Postfix) with ESMTP id A9AEB60DA7; Fri, 21 Aug 2020 07:23:33 +0000 (UTC) Subject: Re: [edk2-devel] running CI locally From: "Laszlo Ersek" To: Sean Brogan , devel@edk2.groups.io, michael.d.kinney@intel.com, Sean Brogan , Bret Barkelew Cc: Vladimir Olovyannikov , Rebecca Cran , Tom Lendacky References: <2d9572c6-7549-d0ae-3ec9-95158cfef484@redhat.com> Message-ID: <5ca9187c-96f3-53f1-0ac0-809bc1156ece@redhat.com> Date: Fri, 21 Aug 2020 09:23:32 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <2d9572c6-7549-d0ae-3ec9-95158cfef484@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=lersek@redhat.com X-Mimecast-Spam-Score: 0.002 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi Mike, Sean; On 08/19/20 19:59, Laszlo Ersek wrote: > I'll report back with more results. I installed a Fedora 32 Server VM. Installed the "mono-complete" package (+its deps). Installed the "nodejs" package. Installed "cspell" (+deps) with "npm" (with the latter coming from the nodejs package). Edk2 checked out at current HEAD (5a6d764e1d073d28e8f398289ccb5592bf9a72ba). * Platform CI results: - : Built successfully for IA32, X64, and IA32X64 (toolchain: GCC5). - : Built successfully for ARM and AARCH64 (toolchain: GCC5). * Core CI results: - Complete run successful (toolchain: GCC5); no package / arch / target / test restrictions. I got the following WARNINGs: - ArmVirtPkg, EmulatorPkg, and OvmfPkg are covered by Platform CI, not Core CI -- these are expected: > PROGRESS - --Running ArmVirtPkg: Compiler Plugin DEBUG -- > WARNING - --->Test Skipped: in plugin! Compiler Plugin DEBUG > PROGRESS - --Running ArmVirtPkg: Compiler Plugin RELEASE -- > WARNING - --->Test Skipped: in plugin! Compiler Plugin RELEASE > PROGRESS - --Running EmulatorPkg: Compiler Plugin DEBUG -- > WARNING - --->Test Skipped: in plugin! Compiler Plugin DEBUG > PROGRESS - --Running EmulatorPkg: Compiler Plugin RELEASE -- > WARNING - --->Test Skipped: in plugin! Compiler Plugin RELEASE > PROGRESS - --Running OvmfPkg: Compiler Plugin DEBUG -- > WARNING - --->Test Skipped: in plugin! Compiler Plugin DEBUG > PROGRESS - --Running OvmfPkg: Compiler Plugin RELEASE -- > WARNING - --->Test Skipped: in plugin! Compiler Plugin RELEASE - ArmVirtPkg, DynamicTablesPkg, CryptoPkg, EmulatorPkg, FatPkg, NetworkPkg, OvmfPkg, PcAtChipsetPkg, SecurityPkg and ShellPkg are not covered by host-based unit tests -- I think also expected: > PROGRESS - --Running ArmVirtPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running DynamicTablesPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running CryptoPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running EmulatorPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running FatPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running NetworkPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running OvmfPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running PcAtChipsetPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running SecurityPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT > PROGRESS - --Running ShellPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Compiler Plugin NOOPT - I'm not really sure about the following warnings. They were emitted for a subset of the above packages. I read the docs at but I still don't understand :) > PROGRESS - --Running CryptoPkg: Host Unit Test Dsc Complete Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Dsc Complete Check Test NO-TARGET > PROGRESS - --Running FatPkg: Host Unit Test Dsc Complete Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Dsc Complete Check Test NO-TARGET > PROGRESS - --Running NetworkPkg: Host Unit Test Dsc Complete Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Dsc Complete Check Test NO-TARGET > PROGRESS - --Running PcAtChipsetPkg: Host Unit Test Dsc Complete Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Dsc Complete Check Test NO-TARGET > PROGRESS - --Running SecurityPkg: Host Unit Test Dsc Complete Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Dsc Complete Check Test NO-TARGET > PROGRESS - --Running ShellPkg: Host Unit Test Dsc Complete Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Host Unit Test Dsc Complete Check Test NO-TARGET - Still related to host-based unit tests, I believe the following warnings, for FmpDevicePkg, MdeModulePkg, MdePkg, UefiCpuPkg, and UnitTestFrameworkPkg, report that running the tests on the build host (understandably) prevents the tests from covering all edk2 architectures: > PROGRESS - --Running FmpDevicePkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - Allowing Override for key TARGET_ARCH > PROGRESS - --Running MdeModulePkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - Allowing Override for key TARGET_ARCH > PROGRESS - --Running MdePkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - Allowing Override for key TARGET_ARCH > PROGRESS - --Running UefiCpuPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - Allowing Override for key TARGET_ARCH > PROGRESS - --Running UnitTestFrameworkPkg: Host Unit Test Compiler Plugin NOOPT -- > WARNING - Allowing Override for key TARGET_ARCH - The below seems to be related to the "spell checking in audit mode" known issues at . What does "audit mode" mean? FWIW, the packages listed below (EmulatorPkg, MdeModulePkg, MdePkg, NetworkPkg, OvmfPkg, ShellPkg, UefiCpuPkg) is a proper subset of the packges noted in ".pytool/Readme.md" -- the latter mentions CryptoPkg and SecurityPkg in addition. > PROGRESS - --Running EmulatorPkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET > PROGRESS - --Running MdeModulePkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET > PROGRESS - --Running MdePkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET > PROGRESS - --Running NetworkPkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET > PROGRESS - --Running OvmfPkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET > PROGRESS - --Running ShellPkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET > PROGRESS - --Running UefiCpuPkg: Spell Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Spell Check Test NO-TARGET - Not sure about the last one: > PROGRESS - --Running FatPkg: Library Class Check Test NO-TARGET -- > WARNING - --->Test Skipped: in plugin! Library Class Check Test NO-TARGET * One suggestion (in addition to the others made in this thread): - Please add "BaseToolsBuild" to "BaseTools/.gitignore". * A question: - On github, there is some logic that restricts the full Core CI build to packages that may be affected by a patch series. Is this available locally? According to the Core CI documentation, the "stuart_ci_build" command can be limited with "-p" / "-a" / "-t" flags; given a commit range, how do we calculate the "tightest" flag values? Thank you very much! Laszlo