From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from out03.mta.xmission.com (out03.mta.xmission.com [166.70.13.233]) by mx.groups.io with SMTP id smtpd.web10.2281.1584760510070418375 for ; Fri, 20 Mar 2020 20:15:10 -0700 Authentication-Results: mx.groups.io; dkim=missing; spf=pass (domain: bsdio.com, ip: 166.70.13.233, mailfrom: rebecca@bsdio.com) Received: from in02.mta.xmission.com ([166.70.13.52]) by out03.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jFUbM-0001VO-S6; Fri, 20 Mar 2020 21:15:08 -0600 Received: from mta3.zcs.xmission.com ([166.70.13.67]) by in02.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.87) (envelope-from ) id 1jFUbL-0000ri-Q2; Fri, 20 Mar 2020 21:15:08 -0600 Received: from localhost (localhost [127.0.0.1]) by mta3.zcs.xmission.com (Postfix) with ESMTP id 7F8BE161B52; Fri, 20 Mar 2020 21:15:07 -0600 (MDT) X-Amavis-Modified: Mail body modified (using disclaimer) - mta3.zcs.xmission.com Received: from mta3.zcs.xmission.com ([127.0.0.1]) by localhost (mta3.zcs.xmission.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id x0JnMUYWOmx7; Fri, 20 Mar 2020 21:15:07 -0600 (MDT) Received: from photon.int.bluestop.org (c-174-52-16-57.hsd1.ut.comcast.net [174.52.16.57]) (Authenticated sender: rebecca@bsdio.com) by mta3.zcs.xmission.com (Postfix) with ESMTPSA id 44557161A55; Fri, 20 Mar 2020 21:15:07 -0600 (MDT) To: Bret Barkelew , "devel@edk2.groups.io" , Sean Brogan References: <46ad7e58-edb7-0819-9542-8d6850598292@bsdio.com> From: "Rebecca Cran" Message-ID: <944e781f-0ef8-f12f-14ab-fbaf2f0fb7fa@bsdio.com> Date: Fri, 20 Mar 2020 21:15:06 -0600 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.6.0 MIME-Version: 1.0 In-Reply-To: X-XM-SPF: eid=1jFUbL-0000ri-Q2;;;mid=<944e781f-0ef8-f12f-14ab-fbaf2f0fb7fa@bsdio.com>;;;hst=in02.mta.xmission.com;;;ip=166.70.13.67;;;frm=rebecca@bsdio.com;;;spf=pass X-SA-Exim-Connect-IP: 166.70.13.67 X-SA-Exim-Mail-From: rebecca@bsdio.com X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on sa04.xmission.com X-Spam-Level: *** X-Spam-Status: No, score=3.2 required=8.0 tests=ALL_TRUSTED,BAYES_40, DCC_CHECK_NEGATIVE,FVGT_m_MULTI_ODD,HTML_MESSAGE,LotsOfNums_01, T_TM2_M_HEADER_IN_MSG,TooManyTo_001,TooManyTo_002,TooManyTo_003, XMSubLong,XM_B_Unicode,XM_B_Unicode3,XM_B_Unsub autolearn=disabled version=3.4.2 X-Spam-Report: * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * -0.0 BAYES_40 BODY: Bayes spam probability is 20 to 40% * [score: 0.3310] * 0.7 XMSubLong Long Subject * 0.6 TooManyTo_003 Multiple "To" Header Recipients 4x (uncommon) * 0.3 TooManyTo_001 Multiple "To" Header Recipients 2x (uncommon) * 0.5 TooManyTo_002 Multiple "To" Header Recipients 3x (uncommon) * 0.0 XM_B_Unicode3 BODY: Testing for specific types of unicode * 0.0 T_TM2_M_HEADER_IN_MSG BODY: No description available. * 0.0 XM_B_Unicode BODY: Testing for specific types of unicode * 1.2 LotsOfNums_01 BODY: Lots of long strings of numbers * 0.0 HTML_MESSAGE BODY: HTML included in message * -0.0 DCC_CHECK_NEGATIVE Not listed in DCC * [sa04 1397; IP=ok Body=1 Fuz1=1] [Fuz2=1] * 0.4 FVGT_m_MULTI_ODD Contains multiple odd letter combinations * 0.5 XM_B_Unsub Unsubscribe in body of email but missing unsubscribe * header X-Spam-DCC: XMission; sa04 1397; IP=ok Body=1 Fuz1=1 Fuz2=1 X-Spam-Combo: ***;Bret Barkelew , "devel@edk2.groups.io" , Sean Brogan X-Spam-Relay-Country: X-Spam-Timing: total 787 ms - load_scoreonly_sql: 0.07 (0.0%), signal_user_changed: 10 (1.3%), b_tie_ro: 9 (1.1%), parse: 1.52 (0.2%), extract_message_metadata: 37 (4.8%), get_uri_detail_list: 9 (1.2%), tests_pri_-1000: 23 (2.9%), tests_pri_-950: 1.34 (0.2%), tests_pri_-900: 1.06 (0.1%), tests_pri_-90: 98 (12.4%), check_bayes: 89 (11.3%), b_tokenize: 19 (2.5%), b_tok_get_all: 13 (1.6%), b_comp_prob: 4.2 (0.5%), b_tok_touch_all: 48 (6.1%), b_finish: 1.07 (0.1%), tests_pri_0: 594 (75.5%), check_dkim_signature: 0.96 (0.1%), check_dkim_adsp: 20 (2.6%), poll_dns_idle: 16 (2.0%), tests_pri_10: 4.1 (0.5%), tests_pri_500: 13 (1.6%), rewrite_mail: 0.00 (0.0%) Subject: Re: [EXTERNAL] [edk2-devel] Information about the VMs used to do EDK2 CI? X-Spam-Flag: No X-SA-Exim-Version: 4.2.1 (built Thu, 05 May 2016 13:38:54 -0600) X-SA-Exim-Scanned: Yes (on in02.mta.xmission.com) Content-Type: multipart/alternative; boundary="------------70C2103615B01DD783A2312E" Content-Language: en-US --------------70C2103615B01DD783A2312E Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Thanks! It was the singe-threaded part that I was interested in. But also, it sounds like for more complex/in-depth testing such as running QEMU to do runtime validation and regression-testing of OVMF etc. we'll want to set up our own agents, since the hosted ones are relatively restrictive. -- Rebecca Cran On 2020-03-20 19:46, Bret Barkelew wrote: > > CI runs on the DevOps pool for ubuntu-latest and windows-latest, > respectively… > > https://github.com/tianocore/edk2/blob/0c8ea9fe1adbbee230ee0c68f28b68ca2b0534bc/.azurepipelines/Ubuntu-GCC5.yml#L16 > > https://github.com/tianocore/edk2/blob/0c8ea9fe1adbbee230ee0c68f28b68ca2b0534bc/.azurepipelines/Windows-VS2019.yml#L17 > >   > > As for OS, it looks like this table is kept up-to-date: > > https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops#use-a-microsoft-hosted-agent > >   > > I **think** they may be assumed to be single-threaded and parallelism > is accomplished via “jobs”: > > https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops#capabilities-and-limitations > > (@Sean may correct me on that) > >   > > What details do you need and I’ll try to find them. 😊 > >   > > - Bret > >   > > *From: *Rebecca Cran via Groups.Io > *Sent: *Friday, March 20, 2020 6:33 PM > *To: *devel@edk2.groups.io > *Subject: *[EXTERNAL] [edk2-devel] Information about the VMs used to > do EDK2 CI? > >   > > I was wondering if it might be possible to get information about the VMs > used to run EDK2 CI? > > For example I noticed the Edk2ToolsBuild.py script doesn't try and build > BaseTools in parallel, causing it to take 45 seconds - whereas it takes > around 10 when run with "make -j4" and 6 with "make -j16". However, > without knowing the specifications of the VMs used, I'm not sure if I > should work on optimizing things like that to run better. > > > -- > Rebecca Cran > > > > > >   > --------------70C2103615B01DD783A2312E Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit
Thanks! It was the singe-threaded part that I was interested in. But also, it sounds like for more complex/in-depth testing such as running QEMU to do runtime validation and regression-testing of OVMF etc. we'll want to set up our own agents, since the hosted ones are relatively restrictive.

--
Rebecca Cran

On 2020-03-20 19:46, Bret Barkelew wrote:

CI runs on the DevOps pool for ubuntu-latest and windows-latest, respectively…

https://github.com/tianocore/edk2/blob/0c8ea9fe1adbbee230ee0c68f28b68ca2b0534bc/.azurepipelines/Ubuntu-GCC5.yml#L16

https://github.com/tianocore/edk2/blob/0c8ea9fe1adbbee230ee0c68f28b68ca2b0534bc/.azurepipelines/Windows-VS2019.yml#L17

 

As for OS, it looks like this table is kept up-to-date:

https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops#use-a-microsoft-hosted-agent

 

I *think* they may be assumed to be single-threaded and parallelism is accomplished via “jobs”:

https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops#capabilities-and-limitations

(@Sean may correct me on that)

 

What details do you need and I’ll try to find them. 😊

 

- Bret

 

From: Rebecca Cran via Groups.Io
Sent: Friday, March 20, 2020 6:33 PM
To: devel@edk2.groups.io
Subject: [EXTERNAL] [edk2-devel] Information about the VMs used to do EDK2 CI?

 

I was wondering if it might be possible to get information about the VMs
used to run EDK2 CI?

For example I noticed the Edk2ToolsBuild.py script doesn't try and build
BaseTools in parallel, causing it to take 45 seconds - whereas it takes
around 10 when run with "make -j4" and 6 with "make -j16". However,
without knowing the specifications of the VMs used, I'm not sure if I
should work on optimizing things like that to run better.


--
Rebecca Cran



 




--------------70C2103615B01DD783A2312E--