From mboxrd@z Thu Jan  1 00:00:00 1970
Authentication-Results: mx.groups.io;
 dkim=missing; spf=pass (domain: redhat.com, ip: 209.132.183.28, mailfrom: lersek@redhat.com)
Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28])
 by groups.io with SMTP; Fri, 30 Aug 2019 06:11:08 -0700
Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16])
	(using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by mx1.redhat.com (Postfix) with ESMTPS id D339169EE0;
	Fri, 30 Aug 2019 13:11:07 +0000 (UTC)
Received: from lacos-laptop-7.usersys.redhat.com (unknown [10.36.118.66])
	by smtp.corp.redhat.com (Postfix) with ESMTP id 7A66A5C1D4;
	Fri, 30 Aug 2019 13:11:06 +0000 (UTC)
Subject: Re: [edk2-devel] [RFC] EDK II Continuous Integration Phase 1
To: devel@edk2.groups.io, sean.brogan@microsoft.com,
 "rfc@edk2.groups.io" <rfc@edk2.groups.io>,
 "Kinney, Michael D" <michael.d.kinney@intel.com>
Cc: Bret Barkelew <Bret.Barkelew@microsoft.com>
References: <E92EE9817A31E24EB0585FDF735412F5B9DA6404@ORSMSX113.amr.corp.intel.com>
 <DM5PR21MB08425D166A0D03CAADA3FCD9E1BD0@DM5PR21MB0842.namprd21.prod.outlook.com>
From: "Laszlo Ersek" <lersek@redhat.com>
Message-ID: <993588d5-b755-9d72-ec2b-7eb1ad6b6a7e@redhat.com>
Date: Fri, 30 Aug 2019 15:11:05 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101
 Thunderbird/52.9.1
MIME-Version: 1.0
In-Reply-To: <DM5PR21MB08425D166A0D03CAADA3FCD9E1BD0@DM5PR21MB0842.namprd21.prod.outlook.com>
X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.25]); Fri, 30 Aug 2019 13:11:07 +0000 (UTC)
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 7bit

Hi Sean,

On 08/30/19 04:21, Sean via Groups.Io wrote:
> would like to see these two efforts merged together.

> Currently if the full set of tests are run we take about 20 minutes.
> This is because compiling MdeModulePkg for debug, release, and host
> based tests take a while.  Most other packages are in the 10 minute
> range.  We do have easy ways to disable or limit certain tests as well
> as expand the matrix to leverage more cloud resources (more parallel
> builds).

> ### Module Inclusion Test - DscCompleteCheck
> ### Code Compilation Test - CompilerPlugin
> ### Host-Based UnitTests - HostUnitTestCompilerPlugin and
>     HostUnitTestDscCompleteCheck
> ### GUID Uniqueness Test - GuidCheck
> ### Cross-Package Dependency Test - DependencyCheck
> ### Library Declaration Test - LibraryClassCheck
> ### Invalid Character Test - CharEncodingCheck

These tests sound awesome!

> ## Next Steps
>
> * Receive community feedback on RFC.
> * Determine where this phase makes sense given existing RFCs from
>   other TianoCore contributors.
> * Optimize testing beharior.
>   * Only run a subset of tests on PRs or individual commits.
>   * Run full testing either once per day or once every several
      commits.

I'd like to keep the per-PR tests down to 10 minutes.

On the other hand, it would be great if all of these tests could be
performed daily or weekly.

Are these tests easy to integrate with the infrastructure described by
Mike?

Thanks,
Laszlo