From mboxrd@z Thu Jan  1 00:00:00 1970
Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124])
 by mx.groups.io with SMTP id smtpd.web10.1735.1614877447544280608
 for <devel@edk2.groups.io>;
 Thu, 04 Mar 2021 09:04:08 -0800
Authentication-Results: mx.groups.io;
 dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=AFaKRyqz;
 spf=pass (domain: redhat.com, ip: 216.205.24.124, mailfrom: lersek@redhat.com)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;
	s=mimecast20190719; t=1614877446;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding;
	bh=OLVLeC7Pr+0zc25CAbzUxQpBWwQHZGUPg6IYOoKdq20=;
	b=AFaKRyqzFPpjkaGfADabdshkdiB/N7mUmVHfM0h8tMo46WoUuCW73+iIl/HpVZfBXwx/pd
	XMEHZL1dHoFf2tgwkeMiO94U7hp1L16lP4a+i7J20XPIsY5DCXP+Rg5ODGhFFzhxgOWx1J
	qFRkLw5Tx/8WdRG/rBuOdTAqj5Sw9uE=
Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com
 [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id
 us-mta-497-_yet27O3PrmUSHiiYcIQUA-1; Thu, 04 Mar 2021 12:04:03 -0500
X-MC-Unique: _yet27O3PrmUSHiiYcIQUA-1
Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14])
	(using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 7E2781074667;
	Thu,  4 Mar 2021 17:04:02 +0000 (UTC)
Received: from lacos-laptop-7.usersys.redhat.com (ovpn-112-76.ams2.redhat.com [10.36.112.76])
	by smtp.corp.redhat.com (Postfix) with ESMTP id 76D127BCB6;
	Thu,  4 Mar 2021 17:04:01 +0000 (UTC)
From: "Laszlo Ersek" <lersek@redhat.com>
Subject: generating the test matrix for local CI runs
To: edk2-devel-groups-io <devel@edk2.groups.io>
Cc: Sean Brogan <sean.brogan@microsoft.com>,
 Bret Barkelew <Bret.Barkelew@microsoft.com>,
 Michael Kinney <michael.d.kinney@intel.com>
Message-ID: <95b5738d-6af2-15ea-e69d-759b1599b00d@redhat.com>
Date: Thu, 4 Mar 2021 18:04:00 +0100
MIME-Version: 1.0
X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14
Authentication-Results: relay.mimecast.com;
	auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=lersek@redhat.com
X-Mimecast-Spam-Score: 0
X-Mimecast-Originator: redhat.com
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 7bit

(Sigh, my address book pulled one over me -- resending to the correct
list address now. Please ignore the previous posting that you may have
gotten "in private".)

Hi All,

while I can run specific CI tests locally, using the commands listed at:

https://github.com/tianocore/edk2/tree/master/.pytool
https://github.com/tianocore/edk2/tree/master/ArmVirtPkg/PlatformCI
https://github.com/tianocore/edk2/tree/master/OvmfPkg/PlatformCI

I don't know how I can determine and drive the whole "test plan" locally.

When I submit a PR to github, "something" generates (say) 83 test cases.
How can I run that "something" locally?

Assume I have the following:
- a Linux builder VM, with up-to-date tools,
- a Windows builder VM, with up-to-date tools,
- a topic branch, on top of "master".

How do I generate and run those same 83 tests, locally?

It has happened to me that all my local CI steps succeeded (meaning both
the Windows and the Linux builder), but github still rejected the PR --
the reason was that I failed to think of a particular test that github
would run. Composing 83 "stuart" command lines isn't something I'd like
to do manually.

Thanks
Laszlo