From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by mx.groups.io with SMTP id smtpd.web09.6512.1625210602660201736 for ; Fri, 02 Jul 2021 00:23:23 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@intel.onmicrosoft.com header.s=selector2-intel-onmicrosoft-com header.b=kb8c5hBw; spf=pass (domain: intel.com, ip: 134.134.136.100, mailfrom: steven.shi@intel.com) X-IronPort-AV: E=McAfee;i="6200,9189,10032"; a="272541269" X-IronPort-AV: E=Sophos;i="5.83,316,1616482800"; d="png'150?scan'150,208,217,150";a="272541269" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 02 Jul 2021 00:23:20 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.83,316,1616482800"; d="png'150?scan'150,208,217,150";a="482199724" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by FMSMGA003.fm.intel.com with ESMTP; 02 Jul 2021 00:23:20 -0700 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.4; Fri, 2 Jul 2021 00:23:20 -0700 Received: from orsmsx608.amr.corp.intel.com (10.22.229.21) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.4; Fri, 2 Jul 2021 00:23:19 -0700 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx608.amr.corp.intel.com (10.22.229.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.4 via Frontend Transport; Fri, 2 Jul 2021 00:23:19 -0700 Received: from NAM11-DM6-obe.outbound.protection.outlook.com (104.47.57.169) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2242.4; Fri, 2 Jul 2021 00:23:19 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=n+OBbysjDhY12BKGr3iv1SG959qEMAGwWeEiEXJ15xpYaYD5ba39tlvazspkRRVRZuNL/cXhSr0pL9Nxy7WLEa2WqqrXrqHroSVQ8RKkmbvpVVGVuzt1tLSA/dWS0y+AsRi8CIvihzPRJfSgfOy2RrdYWPPb2Z8KIqPItrUgek5SnVlcg0fNfhICfUwuvqR//PvPzN4jpSm2mLwkkGhfp4XzJoJJsk07z3pNbWh+TbLzxhw7Aaw7uyNH4XULIREdcX99soecU2THtK3bq9grqH5h/h7sKQU3RLdZAw2fFOsbi72Y6Wqq2T3/11f5zgcpGc1v1/1w1w8afifSX2fIdA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GcFblMVQCuWwlDO2UGl4Z524g96rcjOwShp+ROTnvhI=; b=Q6JEs/j0+1bobKnUd1H6AKWsBMihsqzrxD7QHNFqJqc8Itq33twwzwNXSI6xixnFRwOwgSePDet/7JeBjoL0Oclw7Xr6VGepKfwCxLMFIaGHcBkTOn83Ns4poRtTpThYywqGM+q27/w6eqWFSJooIXP62gCjom21w3CvV372ouXlbSpf5sSlPWPiYOHJjYSJs5gkECeQmhRgaUKPl6m5XqzUvpltHmhRf1sKPHseEJmRomtb3apDkPIKlZ+Tkr+6SkopQIRCsfmyK/l7okZ7JHcJgSexcfDTs20uUaAB5sN3K/Wgk0oJQ1AnGWjHrY+8lFuvwo7ujT2vYP6DrA8Ykw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GcFblMVQCuWwlDO2UGl4Z524g96rcjOwShp+ROTnvhI=; b=kb8c5hBwArJhtKE1IAqZvymZ+onuhNu82fT3CajT9DjnseybUJ1PMrkjB0uF1lZKGMpjNddHkhjSIHmv2oXhM13UY96yD/lRLPbAQ+asTErUEhXeq5OBUyuWO6EM7yRmpQKwWf72darhR8zhqcgZ1AcN6Xgt9Rh8G1+iGIOl98k= Received: from DM4PR11MB5549.namprd11.prod.outlook.com (2603:10b6:5:388::7) by DM6PR11MB3369.namprd11.prod.outlook.com (2603:10b6:5:b::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22; Fri, 2 Jul 2021 07:23:17 +0000 Received: from DM4PR11MB5549.namprd11.prod.outlook.com ([fe80::d4bb:d75e:3801:1b2d]) by DM4PR11MB5549.namprd11.prod.outlook.com ([fe80::d4bb:d75e:3801:1b2d%6]) with mapi id 15.20.4287.027; Fri, 2 Jul 2021 07:23:17 +0000 From: "Steven Shi" To: "devel@edk2.groups.io" , "Shi, Steven" , Rebecca Cran , Bret Barkelew , "rebecca@nuviainc.com" Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? Thread-Topic: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? Thread-Index: Addsh/lWzUAlUAcaQu2uOb3cnLs5EgAWBDaAAAcGFCAAAmkagAAArvCAAHTqBaAAAH15AAAAxSMwAAExVQAAATCF8AAJQyfw Date: Fri, 2 Jul 2021 07:23:17 +0000 Message-ID: References: <1493b987-b1ed-cb10-8049-107ba1b6f3b0@nuviainc.com> <18761d7c-2069-93e2-b444-1ada9e0a8966@nuviainc.com> <1350abe8-83ba-3b4e-6b8d-8f872c73347d@bsdio.com> In-Reply-To: Accept-Language: zh-CN, en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-reaction: no-action dlp-version: 11.5.1.3 authentication-results: edk2.groups.io; dkim=none (message not signed) header.d=none;edk2.groups.io; dmarc=none action=none header.from=intel.com; x-originating-ip: [192.198.142.22] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 77342248-6fe8-465e-ed2a-08d93d2a4326 x-ms-traffictypediagnostic: DM6PR11MB3369: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: K6hMisQTBw+MPQT2OA+g3v1Ib+De0Hq/ZZ1lUiV0RMctNB7NpSwBGHxf3W2yP8B4qgMSETN4tLioJZl7MhKxRyu6fWLmS7ncSK2ZuM9f1brKcCXRHrPUxBsd8vqc/S2ZEH14UzZR+S5jicrx0gLri4A/9tkN7HiwhTRxwNzC7IPw7+UppDUtvakKsZSGyi/rkoehaKMxTweTphH7NGKq6bcBS8Z/dNwnXyoVIRg6xr1RdKP+PlXc33KwbXCWJjRbxYBKxeUXrILSsjgqrARjd06Ci0smsl8vgTJ5WiqsImBFCdvj6XaXew4k4kE9omrMCbTkKFgtF7sS2HLDvR2PeLp5hPSW7bncsVtoV/ugbEua4l8p8kDbitWHBfv3lJDufRUhbK+aY5usJ7aJC5bvc4YMz9znrZAbSU3EPQPORj0pnyqvRU3IB5PZsiqsDpQIXxAO/l+gqEi1jWI0wEHLRCYghClVTlSmBYUhBPC6nkoI8TZauVH2vzjkzWZ5ovo3lczCeQy2cAys8HwsbcEHCMNEC0bIaCilz7V3xYZdA67CZ2elmAaPHT+MyRo5Lye3wOkur/tJSdshy9N7ZNp2sg0ZLlm0yC9CBrt7pYeZ5SIlJnfG895Y3aGJrSffU3fvBTSeriWYeta3mSR0EX9MPlDUQKP+RcoiHspBcB0Snt04pZSlJsQcNIg8P7e9fWDu6XJn2lMNkeuvIiaHeUQokT9RDoglIjNqarmcpI3C8klBxBPisRBZYdHNZSOf5OT67ISuP9UmEGQQlyU3x6PEtGQbXRuRSIEJs9Oj5iegUWTMMqRFL8BUwx8/MmbFmYItk5PLO9UMp54af6XQaSfbbOt1jfuP5WDY8qdKtu+8+61uDL5sT7I0NWxuPhwhTkK9D3r3AIs/W6+b2ZKMK+GeSFUzPguiE1gd+ygN0gYJClg= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM4PR11MB5549.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(396003)(136003)(346002)(39860400002)(376002)(366004)(45080400002)(316002)(110136005)(71200400001)(66616009)(66476007)(66556008)(64756008)(66446008)(66946007)(7696005)(26005)(6506007)(53546011)(5660300002)(478600001)(76116006)(186003)(2940100002)(55016002)(76236003)(52536014)(30864003)(8676002)(9686003)(86362001)(2906002)(83380400001)(166002)(966005)(99936003)(8936002)(38100700002)(33656002)(122000001)(21314003)(579004)(460985005)(2480315003);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?BU5JVHpYdpoNjqPwkGEIGemyOVsEKzB9IMDJ7dFUdWu4i1KVUGOa1n99zJli?= =?us-ascii?Q?1zkOENPsK0zMeRhT8f5EYf0MivYbpzdK7YM51Je1Wc2t/SKiFPaiqljcc+Xu?= =?us-ascii?Q?2/LiDEwTBtNHEhx7PSq10Oho6g+juAb5vbZhelP1QCKMd8dny0RSRe8pg+C6?= =?us-ascii?Q?huq0IB56YnRxiudjhQ1eksC/dpXj4BoSW5BsbgnbDgoPO1qxgQbat1p2LjoI?= =?us-ascii?Q?m8QtxKd0Ld/GCedknPyYdYF9HOVKi6SSAA0++AD/h4ylynzy5vC3K6WFvYUs?= =?us-ascii?Q?6gnct86qabIqcLJLnhjXrW0ldrJjgGKTSv2pkqVJvZDkesJGRkDMrEc133Is?= =?us-ascii?Q?o5YXFL1n5whdobkjRCb+8L1PtNho8QZWbpJdpRFyUFb0H1SUl+TyrEClxNMx?= =?us-ascii?Q?L886IbMcRKQ0QjJb3RQAhtbhkFYgqxGhSKeqDfvxX6VkKE3U/31+jlPOx5/y?= =?us-ascii?Q?OORHMA9w5l5y9hO3AuHL/coKd996I2Xx/9joQ07rjRAboWolTXecU2thSmWO?= =?us-ascii?Q?pJozzVRTQOrF4aMo72z/C4xDc++3+6Lu6Xfzm6bGDo/vSNh/dO4iI08gm6al?= =?us-ascii?Q?ShgezA3zbHUzVPhuYEGioZhKwX0YoriiociaNgNH3y58Zcad0HdNqQ2f2Nc+?= =?us-ascii?Q?IaNzqHflsFwxMHv6TgeAvn5PxN/vNuERZkbfp40EPK7aED4X/+/+iWHzT5Ne?= =?us-ascii?Q?g+y8ulSCKm7azwHc4opCeDyeW0RegfW7W8s++zKKpAjrUbvwm1JqIUpd1M4w?= =?us-ascii?Q?2PlghgEcMXSD0SrcJlzTOZEQozLsYEcUiIsy/bXDyJseU7LQyE/sKk4CYypG?= =?us-ascii?Q?PdjzsI3OLv93EAKPt1cdWVUmw+H/BN3zAPwotR0RaEJopTRGcyRRf8WJhD5V?= =?us-ascii?Q?oc9B/sj4pGTR5YuXbU/2Ozd6YEJ7la+DkCFjijBNqeFpWgee6YiWmKaTZ663?= =?us-ascii?Q?izeWC+QHMQ+6SbqtfiVn2q0I/wbGmuJkYuJ4qSEP3o0MjStVY9W7fvu5OXEn?= =?us-ascii?Q?LjufFQGyerXyQM5reINXfIVnd1OVGjaH7xN8JhXgETKac37NDmludhgMD6kP?= =?us-ascii?Q?dg7AmLBhJ1OkdVvIttJu21LT/TBslGplFH9SCGbhnQLvZuxtmJF4f3x5K2DH?= =?us-ascii?Q?P+1oPlcmk0zEzbYZJxQ+VqBXgCeU1XQFQnNGfyNP9zaY+ucgjlALWOen8217?= =?us-ascii?Q?aNuNGjsRSTu9+2cRUizBUaCzxR2i0adENmIrvUtJq4aPSMwKxSiuoR+dYq87?= =?us-ascii?Q?VXXrzmuFDA6aLpA5V/PWP9r2E8BRVwRVCWg1WInkwWrp/Cz603P9CSXyeBiH?= =?us-ascii?Q?MmHTPJD3N1flKtohNdLlnSAH?= MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB5549.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 77342248-6fe8-465e-ed2a-08d93d2a4326 X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Jul 2021 07:23:17.3484 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: eDWtmsAUduMJJmODabUPDU8M0OD1/5liYOpyIJQDDuegL7+5QY0NV/QKaPNFCYg5DDL7qbERlWl+09hovF+pKw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR11MB3369 Return-Path: steven.shi@intel.com X-OriginatorOrg: intel.com X-Groupsio-MsgNum: 77439 Content-Language: en-US Content-Type: multipart/related; boundary="_004_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_"; type="multipart/alternative" --_004_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_ Content-Type: multipart/alternative; boundary="_000_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_" --_000_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Bret, For my failure of "Unable to load the service index for source...", I see= it might be the Nuget proxy setting issue: https://stackoverflow.com/quest= ions/41185443/nuget-connection-attempt-failed-unable-to-load-the-service-in= dex-for-source. I tried to set the Nuget https_proxy and http_proxy as belo= w, but it still does not work. Do you know how to set the Nuget Proxy in Py= tool? (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ mono /home/jshi19/w= ksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe= config -set https_proxy=3Dhttp://xxx:xxxx@xxxx.intel.com:xxx (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ mono /home/jshi19/w= ksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe= config -set http_proxy=3Dhttp://xxx:xxxx@xxxx.intel.com:xxx (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ mono /home/jshi19/w= ksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe= install edk2-acpica-iasl -Source https://pkgs.dev.azure.com/projectmu/acpi= ca/_packaging/mu_iasl/nuget/v3/index.json -ExcludeVersion -NonInteractive -= Version 20200717.0.0 -Verbosity detailed -OutputDirectory "/home/jshi19/wks= p_efi/edk2-2/BaseTools/Bin/edk2-acpica-iasl_extdep_temp" NuGet Version: 5.3.1.6268 Feeds used: https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/= index.json Attempting to gather dependency information for package 'edk2-acpica-iasl.= 20200717.0.0' with respect to project '/home/jshi19/wksp_efi/edk2-2/BaseToo= ls/Bin/edk2-acpica-iasl_extdep_temp', targeting 'Any,Version=3Dv0.0' Unable to load the service index for source https://pkgs.dev.azure.com/pro= jectmu/acpica/_packaging/mu_iasl/nuget/v3/index.json. GSSAPI operation failed with error - Unspecified GSS failure. Minor cod= e may provide more information (SPNEGO cannot find mechanisms to negotiate)= . System.InvalidOperationException: Unable to load the service index for sou= rce https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3= /index.json. ---> NuGet.Protocol.Core.Types.FatalProtocolException: Unable = to load the service index for source https://pkgs.dev.azure.com/projectmu/a= cpica/_packaging/mu_iasl/nuget/v3/index.json. ---> System.ComponentModel.Wi= n32Exception: GSSAPI operation failed with error - Unspecified GSS failure.= Minor code may provide more information (SPNEGO cannot find mechanisms to= negotiate). at System.Net.NTAuthentication.GetOutgoingBlob (System.Byte[] incomingBl= ob, System.Boolean throwOnError, System.Net.SecurityStatusPal& statusCode) = [0x00258] in :0 at System.Net.NTAuthentication.GetOutgoingBlob (System.String incomingBl= ob) [0x00045] in :0 Thanks Steven Shi Intel\IAGS\SFP\FIA (Firmware Infrastructure Automation) From: devel@edk2.groups.io On Behalf Of Steven Shi Sent: Friday, July 2, 2021 10:44 AM To: Rebecca Cran ; devel@edk2.groups.io; Bret Barkelew = ; rebecca@nuviainc.com Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in= Linux? Thank you to Rebecca. After install the libmono-system-net-http4.0-cil and= mono-devel pkg as below, the 'mono /home/jshi19/wksp_efi/unit_test_env/lib= /python3.8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -= list' pass. (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ sudo apt-get instal= l libmono-system-net-http4.0-cil (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ sudo apt-get instal= l mono-devel But now there are new failures show up when install edk2-acpica-iasl: (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_update -c .p= ytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5 -v ... ... INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3= .8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3= .8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list INFO - ------------------------------------------------ INFO - ------------------------------------------------ INFO - --------------Cmd Output Starting--------------- INFO - --------------Cmd Output Starting--------------- INFO - ------------------------------------------------ INFO - ------------------------------------------------ ...INFO - global-packages: /home/jshi19/.nuget/packages/ INFO - global-packages: /home/jshi19/.nuget/packages/ INFO - ------------------------------------------------ INFO - --------------Cmd Output Finished--------------- INFO - ------------------------------------------------ INFO - --------- Running Time (mm:ss): 00:00 ---------- INFO - --------------Cmd Output Finished--------------- INFO - ----------- Return Code: 0x00000000 ------------ INFO - --------- Running Time (mm:ss): 00:00 ---------- INFO - ------------------------------------------------ INFO - ----------- Return Code: 0x00000000 ------------ INFO - Could not determine Nuget global packages cache location. INFO - ------------------------------------------------ INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3= .8/site-packages/edk2toolext/bin/NuGet.exe install edk2-acpica-iasl -Source= https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/in= dex.json -ExcludeVersion -NonInteractive -Version 20200717.0.0 -Verbosity d= etailed -OutputDirectory "/home/jshi19/wksp_efi/edk2-2/BaseTools/Bin/edk2-a= cpica-iasl_extdep_temp" INFO - Could not determine Nuget global packages cache location. INFO - ------------------------------------------------ INFO - --------------Cmd Output Starting--------------- INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3= .8/site-packages/edk2toolext/bin/NuGet.exe install mu_nasm -Source https://= api.nuget.org/v3/index.json -ExcludeVersion -NonInteractive -Version 2.15.0= 5 -Verbosity detailed -OutputDirectory "/home/jshi19/wksp_efi/edk2-2/BaseTo= ols/Bin/mu_nasm_extdep_temp" INFO - ------------------------------------------------ INFO - ------------------------------------------------ INFO - --------------Cmd Output Starting--------------- INFO - ------------------------------------------------ INFO - NuGet Version: 5.3.1.6268 INFO - NuGet Version: 5.3.1.6268 INFO - Feeds used: INFO - https://api.nuget.org/v3/index.json INFO - INFO - INFO - INFO - Feeds used: INFO - https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nu= get/v3/index.json INFO - INFO - Attempting to gather dependency information for package 'mu_nasm.2.= 15.5' with respect to project '/home/jshi19/wksp_efi/edk2-2/BaseTools/Bin/m= u_nasm_extdep_temp', targeting 'Any,Version=3Dv0.0' INFO - INFO - INFO - Attempting to gather dependency information for package 'edk2-acpic= a-iasl.20200717.0.0' with respect to project '/home/jshi19/wksp_efi/edk2-2/= BaseTools/Bin/edk2-acpica-iasl_extdep_temp', targeting 'Any,Version=3Dv0.0' INFO - Unable to load the service index for source https://pkgs.dev.azure.= com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/index.json. INFO - GSSAPI operation failed with error - An invalid name was supplied= (Configuration file does not specify default realm). INFO - System.InvalidOperationException: Unable to load the service index = for source https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/n= uget/v3/index.json. ---> NuGet.Protocol.Core.Types.FatalProtocolException: = Unable to load the service index for source https://pkgs.dev.azure.com/proj= ectmu/acpica/_packaging/mu_iasl/nuget/v3/index.json. ---> System.ComponentM= odel.Win32Exception: GSSAPI operation failed with error - An invalid name w= as supplied (Configuration file does not specify default realm). INFO - at System.Net.Security.NegotiateStreamPal.AcquireCredentialsHandl= e (System.String package, System.Boolean isServer, System.Net.NetworkCreden= tial credential) [0x000a3] in :0 ... ... Thanks Steven Shi Intel\IAGS\SFP\FIA (Firmware Infrastructure Automation) From: Rebecca Cran > Sent: Friday, July 2, 2021 10:00 AM To: devel@edk2.groups.io; Shi, Steven >; Bret Barkelew >; rebecca@nuviainc.com Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in= Linux? That means you need to install the various mono assemblies, such as the li= bmono-system-net-http4.0-cil package in Ubuntu. I spent some time chasing down the dependencies last year which got very f= rustrating and tedious, but have forgotten which were needed. All I remembe= r is there were quite a lot. -- Rebecca Cran On 7/1/21 7:36 PM, Steven Shi wrote: I already installed mono, but NuGet.exe still fails to work in my side. I'= m behind a proxy but don't know how to configure the NuGet.exe proxy in .py= tool. Below is my verbose error message. (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_update -c .p= ytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5 -v ... ... SECTION - Start Invocable Tool SECTION - Initial update of environment DEBUG - --- self_describing_environment.update_extdeps() DEBUG - Verify 'mu_nasm' returning 'False'. DEBUG - Verify 'edk2-acpica-iasl' returning 'False'. DEBUG - Creating 5 threads for the SDE update UpdatingDEBUG - Verify 'gcc_aarch64_linux' returning 'True'. DEBUG - Verify 'gcc_riscv64_unknown' returning 'True'. DEBUG - Verify 'mu_nasm' returning 'False'. DEBUG - Verify 'gcc_arm_linux' returning 'True'. DEBUG - Verify 'edk2-acpica-iasl' returning 'False'. DEBUG - Cleaning dependency directory for 'mu_nasm'... DEBUG - Cleaning dependency directory for 'edk2-acpica-iasl'... INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3= .8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3= .8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list INFO - ------------------------------------------------ INFO - ------------------------------------------------ INFO - --------------Cmd Output Starting--------------- INFO - --------------Cmd Output Starting--------------- INFO - ------------------------------------------------ INFO - ------------------------------------------------ ...INFO - Could not load file or assembly 'System.Net.Http, Version=3D4.0.= 0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its de= pendencies. INFO - Could not load file or assembly 'System.Net.Http, Version=3D4.0.0= .0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dep= endencies. INFO - Could not load file or assembly 'System.Net.Http, Version=3D4.0.0= .0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dep= endencies. INFO - Could not load file or assembly 'System.Net.Http, Version=3D4.0.0= .0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dep= endencies. INFO - Could not load file or assembly 'System.Net.Http, Version=3D4.0.0= .0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dep= endencies. INFO - System.AggregateException: One or more errors occurred. (Could not = load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutra= l, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (Could n= ot load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneu= tral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (Coul= d not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3D= neutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (C= ould not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture= = =3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.= ) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es.) ---> System.IO.FileNotFoundException: Could not load file or assembly = 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyToken=3Db0= 3f5f7f11d50a3a' or one of its dependencies. INFO - --- End of inner exception stack trace --- ... ... If I run the Cmd manually, I get below error: (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ mono /home/jshi19/w= ksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe= locals global-packages -list Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cultu= re=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies= . Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es. Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es. Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es. Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es. System.AggregateException: One or more errors occurred. (Could not load fi= le or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Publ= icKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (Could not load= file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, P= ublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (Could not l= oad file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral= , PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (Could no= t load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneut= ral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) (Could= not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dn= eutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) ---= > System.IO.FileNotFoundException: Could not load file or assembly 'System.= Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11= d50a3a' or one of its dependencies. --- End of inner exception stack trace --- at NuGet.CommandLine.Program.Initialize (NuGet.IFileSystem fileSystem, N= uGet.CommandLine.IConsole console) [0x000ce] in :0 at NuGet.CommandLine.Program.MainCore (System.String workingDirectory, S= ystem.String[] args) [0x000d8] in :0 ---> (Inner Exception #0) System.IO.FileNotFoundException: Could not load = file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Pu= blicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicK= eyToken=3Db03f5f7f11d50a3a'<--- ---> (Inner Exception #1) System.IO.FileNotFoundException: Could not load = file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Pu= blicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicK= eyToken=3Db03f5f7f11d50a3a'<--- ---> (Inner Exception #2) System.IO.FileNotFoundException: Could not load = file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Pu= blicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicK= eyToken=3Db03f5f7f11d50a3a'<--- ---> (Inner Exception #3) System.IO.FileNotFoundException: Could not load = file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Pu= blicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicK= eyToken=3Db03f5f7f11d50a3a'<--- ---> (Inner Exception #4) System.IO.FileNotFoundException: Could not load = file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Pu= blicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicK= eyToken=3Db03f5f7f11d50a3a'<--- Thanks Steven Shi From: Bret Barkelew Sent: Friday, July 2, 2021 9:04 AM To: Shi, Steven ; devel= @edk2.groups.io; rebecca@nuviainc.com Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in= Linux? I believe the Azure DevOps build agents that are used by the EDK2 CI pipel= ine already have mono installed. - Bret From: Shi, Steven Sent: Thursday, July 1, 2021 5:54 PM To: devel@edk2.groups.io; Bret Barkelew; rebecca@nuviainc.com Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in= Linux? Hi Bret, Rebecca, Thanks for the info. Does edk2 CI run the .pytool unit tests in Linux? If = yes, how does edk2 CI solve the nuget dependency problem in Linux right now= ? Thanks Steven Shi From: devel@edk2.groups.io > On Behalf Of Bret Barkelew via groups.io Sent: Wednesday, June 30, 2021 1:02 AM To: devel@edk2.groups.io; rebecca@nuviainc.co= m; Shi, Steven > Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in= Linux? Hmmm. If that works well, we might be able to investigate carrying both an= d picking based on the host OS. - Bret From: devel@edk2.groups.io > on behalf of Rebecca Cran via groups.io <= rebecca=3Dnuviainc.com@groups.io> Sent: Tuesday, June 29, 2021 9:42:41 AM To: devel@edk2.groups.io >; steven.shi@intel.com > Subject: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Lin= ux? Your Linux distribution should have a nuget package available (e.g. https:= //packages.ubuntu.com/hirsute/nuget) but the EDK2 CI is designed to use the copy of nuget installed with= the edk2toolext package. -- Rebecca Cran On 6/29/21 9:44 AM, Steven Shi wrote: Cran, Thanks. I'm curious whether the .pytool has native Linux executable = binary to run? It looks the edk2 CI framework has more dependency in Linux = than Windows. Thanks Steven Shi Intel\IAGS\SFP\FIA (Firmware Infrastructure Automation) From: devel@edk2.groups.io On Behalf Of Rebecca Cran Sent: Tuesday, June 29, 2021 8:13 PM To: devel@edk2.groups.io; Shi, Steven Subject: Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? NuGet.exe is a .NET assembly/executable, so on Linux you'll need to instal= l Mono (https://www.mono-project.com/). -- Rebecca Cran On 6/28/21 7:45 PM, Steven Shi wrote: Hello, I'm interested in the edk2 CI unit tests(https://github.com/tianocore/edk2= /tree/master/.pytool). I tested it in my local. It works well in Windows but does no= t work in Linux. It looks the NuGet in pytool only has windows version (C:\= steven\unit_test_env\Lib\site-packages\edk2toolext\bin\NuGet.exe) but not s= upport the Linux. Below is my detail test steps. Do the edk2 CI unit tests = work in Linux? 1. Windows : c:\steven>py -m venv unit_test_env c:\steven>cd c:\steven\edk2 c:\steven\edk2>c:\steven\unit_test_env\Scripts\activate.bat (unit_test_env) c:\steven\edk2>pip install --upgrade -r pip-requirements.t= xt (unit_test_env) c:\steven\edk2>stuart_setup -c .pytool/CISettings.py TOOL_= CHAIN_TAG=3DVS2019 (unit_test_env) c:\steven\edk2>stuart_update -c .pytool/CISettings.py TOOL= _CHAIN_TAG=3DVS2019 (unit_test_env) c:\steven\edk2>edksetup.bat (unit_test_env) c:\steven\edk2>edksetup.bat Rebuild (unit_test_env) c:\steven\edk2>stuart_ci_build -c .pytool/CISettings.py TO= OL_CHAIN_TAG=3DVS2019 -a X64,IA32 -t DEBUG --verbose ... PROGRESS - Overall Build Status: Success SECTION - Summary PROGRESS - Success 1. Linux: jshi19@ub2-uefi-b01:~/wksp_efi$ python3 -m venv unit_test_env jshi19@ub2-uefi-b01:~/wksp_efi$ source unit_test_env/bin/activate (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ pip install --upgra= de -r pip-requirements.txt (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ make -C BaseTools/ (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_setup -c .py= tool/CISettings.py TOOL_CHAIN_TAG=3DGCC5 (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_update -c .p= ytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5 SECTION - Init SDE WARNING - Using Pip Tools based BaseTools SECTION - Loading Plugins SECTION - Start Invocable Tool SECTION - Initial update of environment UpdatingWARNING - [SDE] Failed to fetch NugetDependecy: edk2-acpica-iasl@2= 0200717.0.0: [Nuget] We failed to ins= tall this version 20200717.0.0 of edk2-acpica-iasl WARNING - [SDE] Failed to fetch NugetDependecy: mu_nasm@2.15.05: [Nuget] We failed to install this version 2.15.05 of mu_nasm . Done SECTION - Updated/Verified 3 dependencies SECTION - Second pass update of environment UpdatingWARNING - [SDE] Failed to fetch NugetDependecy: edk2-acpica-iasl@2= 0200717.0.0: [Nuget] We failed to ins= tall this version 20200717.0.0 of edk2-acpica-iasl WARNING - [SDE] Failed to fetch NugetDependecy: mu_nasm@2.15.05: [Nuget] We failed to install this version 2.15.05 of mu_nasm . Done SECTION - Updated/Verified 3 dependencies ERROR - We were unable to successfully update 2 dependencies in environmen= t SECTION - Summary ERROR - Error Thanks Steven Shi --_000_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Bret,

For my failure of  “Unable to load the service index for source…”, I see it might be the Nuget proxy setting issue: https://stackoverflow.com/questions/41185443/nuget-connection-attempt-fail= ed-unable-to-load-the-service-index-for-source. I tried to set the Nuge= t https_proxy and http_proxy as below, but it still does not work. Do you k= now how to set the Nuget Proxy in Pytool?

 

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/ed= k2toolext/bin/NuGet.exe config -set https_proxy=3Dhttp://xxx:xxxx@xxxx.inte= l.com:xxx

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/ed= k2toolext/bin/NuGet.exe config -set http_proxy=3Dhttp://xxx:xxxx@xxxx.intel= .com:xxx

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/ed= k2toolext/bin/NuGet.exe install edk2-acpica-iasl -Source https://pkgs.dev.a= zure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/index.json -ExcludeVersion -NonInteractive -Version 20200717.0.0 -Verbosity detailed= -OutputDirectory "/home/jshi19/wksp_efi/edk2-2/BaseTools/Bin/edk2-acp= ica-iasl_extdep_temp"

NuGet Version: 5.3.1.6268

Feeds used:

  https://pkgs.dev.azure.com/projectmu/acpica/= _packaging/mu_iasl/nuget/v3/index.json

Attempting to gather dependency information for pac= kage 'edk2-acpica-iasl.20200717.0.0' with respect to project '/home/jshi19/= wksp_efi/edk2-2/BaseTools/Bin/edk2-acpica-iasl_extdep_temp', targeting 'Any= ,Version=3Dv0.0'

Unable to load the servic= e index for source https://pkgs.dev.azure.com/projectmu/acpica/_packaging/m= u_iasl/nuget/v3/index.json.

  GSSAPI operation f= ailed with error - Unspecified GSS failure.  Minor code may provide mo= re information (SPNEGO cannot find mechanisms to negotiate).

System.InvalidOperationException: Unable to load th= e service index for source https://pkgs.dev.azure.com/projectmu/acpica/_pac= kaging/mu_iasl/nuget/v3/index.json. ---> NuGet.Protocol.Core.Types.Fatal= ProtocolException: Unable to load the service index for source https://pkgs.dev.azure.com/projectmu/acpica/_pac= kaging/mu_iasl/nuget/v3/index.json. ---> System.ComponentModel.Win32Exce= ption: GSSAPI operation failed with error - Unspecified GSS failure.  = Minor code may provide more information (SPNEGO cannot find mechanisms to negotiate).

  at System.Net.NTAuthentication.GetOutgoingBl= ob (System.Byte[] incomingBlob, System.Boolean throwOnError, System.Net.Sec= urityStatusPal& statusCode) [0x00258] in <a85c1a570f9a4f9f9c3d2cfa55= 04e34f>:0

  at System.Net.NTAuthentication.GetOutgoingBl= ob (System.String incomingBlob) [0x00045] in <a85c1a570f9a4f9f9c3d2cfa55= 04e34f>:0

 

Thanks

 

Steven Shi

Intel\IAGS\SFP\FIA (Firmware Infrastructure Autom= ation)

 

 

From: devel@edk2.groups.io <devel@edk2.gr= oups.io> On Behalf Of Steven Shi
Sent: Friday, July 2, 2021 10:44 AM
To: Rebecca Cran <rebecca@bsdio.com>; devel@edk2.groups.io; B= ret Barkelew <Bret.Barkelew@microsoft.com>; rebecca@nuviainc.com
Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests = work in Linux?

 

Thank you to Rebecca. After install the libmono-sys= tem-net-http4.0-cil and mono-devel pkg as below, the ‘mono /home/jshi= 19/wksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet= .exe locals global-packages -list’ pass.

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ sudo apt-get install libmono-system-net-http4.0-cil

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ sudo apt-get install mono-devel

 

But now there are new failures show up when install= edk2-acpica-iasl:

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ stuart_update -c .pytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5 -v

… …

INFO - Cmd to run is: mono /home/jshi19/wksp_efi/un= it_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals gl= obal-packages -list

INFO - Cmd to run is: mono /home/jshi19/wksp_efi/un= it_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals gl= obal-packages -list

INFO - --------------------------------------------= ----

INFO - --------------------------------------------= ----

INFO - --------------Cmd Output Starting-----------= ----

INFO - --------------Cmd Output Starting-----------= ----

INFO - --------------------------------------------= ----

INFO - --------------------------------------------= ----

...INFO - global-packages: /home/jshi19/.nuget/pack= ages/

INFO - global-packages: /home/jshi19/.nuget/package= s/

INFO - --------------------------------------------= ----

INFO - --------------Cmd Output Finished-----------= ----

INFO - --------------------------------------------= ----

INFO - --------- Running Time (mm:ss): 00:00 ------= ----

INFO - --------------Cmd Output Finished-----------= ----

INFO - ----------- Return Code: 0x00000000 --------= ----

INFO - --------- Running Time (mm:ss): 00:00 ------= ----

INFO - --------------------------------------------= ----

INFO - ----------- Return Code: 0x00000000 --------= ----

INFO - Could not determine Nuget global packages ca= che location.

INFO - --------------------------------------------= ----

INFO - Cmd to run is: mono /home/jshi19/wksp_efi/un= it_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe install e= dk2-acpica-iasl -Source https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/in= dex.json -ExcludeVersion -NonInteractive -Version 20200717.0.0 -Verbosi= ty detailed -OutputDirectory "/home/jshi19/wksp_efi/edk2-2/BaseTools/B= in/edk2-acpica-iasl_extdep_temp"

INFO - Could not determine Nuget global packages ca= che location.

INFO - --------------------------------------------= ----

INFO - --------------Cmd Output Starting-----------= ----

INFO - Cmd to run is: mono /home/jshi19/wksp_efi/un= it_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe install m= u_nasm -Source https://api.nuget.org/v3/i= ndex.json -ExcludeVersion -NonInteractive -Version 2.15.05 -Verbosity d= etailed -OutputDirectory "/home/jshi19/wksp_efi/edk2-2/BaseTools/Bin/m= u_nasm_extdep_temp"

INFO - --------------------------------------------= ----

INFO - --------------------------------------------= ----

INFO - --------------Cmd Output Starting-----------= ----

INFO - --------------------------------------------= ----

INFO - NuGet Version: 5.3.1.6268

INFO - NuGet Version: 5.3.1.6268

INFO - Feeds used:

INFO -   https://api.nuget.org/v3/index.json

INFO -

INFO -

INFO -

INFO - Feeds used:

INFO -   https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/in= dex.json

INFO -

INFO - Attempting to gather dependency information = for package 'mu_nasm.2.15.5' with respect to project '/home/jshi19/wksp_efi= /edk2-2/BaseTools/Bin/mu_nasm_extdep_temp', targeting 'Any,Version=3Dv0.0'<= o:p>

INFO -

INFO -

INFO - Attempting to gather dependency information = for package 'edk2-acpica-iasl.20200717.0.0' with respect to project '/home/= jshi19/wksp_efi/edk2-2/BaseTools/Bin/edk2-acpica-iasl_extdep_temp', targeti= ng 'Any,Version=3Dv0.0'

INFO - Unable to load the= service index for source https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/in= dex.json.

INFO -   GSSAPI= operation failed with error - An invalid name was supplied (Configuration = file does not specify default realm).

INFO - System.InvalidOperationException: Unable to = load the service index for source https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/in= dex.json. ---> NuGet.Protocol.Core.Types.FatalProtocolException: Una= ble to load the service index for source https://pkgs.dev.azure.com/projectmu/acpica/_packaging/mu_iasl/nuget/v3/in= dex.json. ---> System.ComponentModel.Win32Exception: GSSAPI operatio= n failed with error - An invalid name was supplied (Configuration file does= not specify default realm).

INFO -   at System.Net.Security.Negotiate= StreamPal.AcquireCredentialsHandle (System.String package, System.Boolean i= sServer, System.Net.NetworkCredential credential) [0x000a3] in <a85c1a57= 0f9a4f9f9c3d2cfa5504e34f>:0

… …

 

Thanks

 

Steven Shi

Intel\IAGS\SFP\FIA (Firmware Infrastructure Autom= ation)

 

 

From: Rebecca Cran <rebecca@bsdio.com>
Sent: Friday, July 2, 2021 10:00 AM
To: devel@edk2.groups.io; Shi, Steven <steven.shi@intel= .com>; Bret Barkelew <Bret.Barkelew@microsoft.com>; rebecca@nuviainc.com
Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests = work in Linux?

 

That means you need= to install the various mono assemblies, such as the libmono-system-net-htt= p4.0-cil package in Ubuntu.

I spent some time c= hasing down the dependencies last year which got very frustrating and tedio= us, but have forgotten which were needed. All I remember is there were quit= e a lot.

 

--
Rebecca Cran

 

On 7/1/21 7:36 PM, Steven Shi wrote:

I already installed mono, but NuGet.exe still fails= to work in my side. I’m behind a proxy but don’t know how to c= onfigure the NuGet.exe proxy in .pytool. Below is my verbose error message.=

 

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ stuart_update -c .pytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5 -v

… …

SECTION - Start Invocable Tool

SECTION - Initial update of environment<= /p>

DEBUG - --- self_describing_environment.update_extd= eps()

DEBUG - Verify 'mu_nasm' returning 'False'.

DEBUG - Verify 'edk2-acpica-iasl' returning 'False'= .

DEBUG - Creating 5 threads for the SDE update<= /o:p>

UpdatingDEBUG - Verify 'gcc_aarch64_linux' returnin= g 'True'.

DEBUG - Verify 'gcc_riscv64_unknown' returning 'Tru= e'.

DEBUG - Verify 'mu_nasm' returning 'False'.

DEBUG - Verify 'gcc_arm_linux' returning 'True'.

DEBUG - Verify 'edk2-acpica-iasl' returning 'False'= .

DEBUG - Cleaning dependency directory for 'mu_nasm'= ...

DEBUG - Cleaning dependency directory for 'edk2-acp= ica-iasl'...

INFO - Cmd to run is: mono /home/jshi19/wksp_efi/un= it_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals gl= obal-packages -list

INFO - Cmd to run is: mono /home/jshi19/wksp_efi/un= it_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals gl= obal-packages -list

INFO - --------------------------------------------= ----

INFO - --------------------------------------------= ----

INFO - --------------Cmd Output Starting-----------= ----

INFO - --------------Cmd Output Starting-----------= ----

INFO - --------------------------------------------= ----

INFO - --------------------------------------------= ----

...INFO - Could not load = file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Pu= blicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.

INFO -   Could = not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dne= utral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.

INFO -   Could = not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dne= utral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.

INFO -   Could = not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dne= utral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.

INFO -   Could = not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dne= utral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.

INFO - System.AggregateException: One or more error= s occurred. (Could not load file or assembly 'System.Net.Http, Version=3D4.= 0.0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its = dependencies.) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyToken=3D= b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or asse= mbly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyToken= = =3Db03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es.) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, = Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) ---> System.IO.FileNotFoundException: Cou= ld not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture= =3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.=

INFO -    --- End of inner exception= stack trace ---

… …

 

 

If I run the Cmd manually, I get below error:<= /o:p>

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2= -2$ mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/ed= k2toolext/bin/NuGet.exe locals global-packages -list

Could not load file or as= sembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyTok= en=3Db03f5f7f11d50a3a' or one of its dependencies.

  Could not load fil= e or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Publi= cKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.=

  Could not load fil= e or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Publi= cKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.=

  Could not load fil= e or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Publi= cKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.=

  Could not load fil= e or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, Publi= cKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.=

System.AggregateException: One or more errors occur= red. (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, = Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its depende= ncies.) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyToken=3D= b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or asse= mbly 'System.Net.Http, Version=3D4.0.0.0, Culture=3Dneutral, PublicKeyToken= = =3Db03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependenci= es.) (Could not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, = Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.) ---> System.IO.FileNotFoundException: Cou= ld not load file or assembly 'System.Net.Http, Version=3D4.0.0.0, Culture= =3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its dependencies.=

   --- End of inner exception stack trace= ---

  at NuGet.CommandLine.Program.Initialize (NuG= et.IFileSystem fileSystem, NuGet.CommandLine.IConsole console) [0x000ce] in= <ff502667b3fe4a85827635c6fe6b0d0d>:0

  at NuGet.CommandLine.Program.MainCore (Syste= m.String workingDirectory, System.String[] args) [0x000d8] in <ff502667b= 3fe4a85827635c6fe6b0d0d>:0

---> (Inner Exception #0) System.IO.FileNotFound= Exception: Could not load file or assembly 'System.Net.Http, Version=3D4.0.= 0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its de= pendencies.

File name: 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a'<---

 

---> (Inner Exception #1) System.IO.FileNotFound= Exception: Could not load file or assembly 'System.Net.Http, Version=3D4.0.= 0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its de= pendencies.

File name: 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a'<---

 

---> (Inner Exception #2) System.IO.FileNotFound= Exception: Could not load file or assembly 'System.Net.Http, Version=3D4.0.= 0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its de= pendencies.

File name: 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a'<---

 

---> (Inner Exception #3) System.IO.FileNotFound= Exception: Could not load file or assembly 'System.Net.Http, Version=3D4.0.= 0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its de= pendencies.

File name: 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a'<---

 

---> (Inner Exception #4) System.IO.FileNotFound= Exception: Could not load file or assembly 'System.Net.Http, Version=3D4.0.= 0.0, Culture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a' or one of its de= pendencies.

File name: 'System.Net.Http, Version=3D4.0.0.0, Cul= ture=3Dneutral, PublicKeyToken=3Db03f5f7f11d50a3a'<---

 

 

Thanks

 

Steven Shi

 

 

From: Bret Barkelew <Bret.Barkelew@microsoft.com>
Sent: Friday, July 2, 2021 9:04 AM
To: Shi, Steven <steven.= shi@intel.com>; devel@edk2.groups.io; rebecca@nuviainc.com
Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests = work in Linux?

 

I believe the Azure DevOps build agents that are us= ed by the EDK2 CI pipeline already have mono installed.

 

- Bret

 

From: Shi, Steven
Sent: Thursday, July 1, 2021 5:54 PM
To: devel@edk2.groups.io; Bret Barkelew; rebecca@nuviain= c.com
Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests = work in Linux?

 

Hi Bret, Rebecca,

Thanks for the info. Does edk2 CI run the .pytool u= nit tests in Linux? If yes, how does edk2 CI solve the nuget dependency pro= blem in Linux right now?

 

 

Thanks

 

Steven Shi

 

 

From: devel@edk2.groups.io <deve= l@edk2.groups.io> On Behalf Of Bret Barkelew via groups.io
Sent: Wednesday, June 30, 2021 1:02 AM
To: devel@edk2.groups.io; rebecca@nuviainc.com; Shi, Steven <steven.shi@intel.com>
Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests = work in Linux?

 

Hmmm. If that works well, we might be able to investigate carrying both= and picking based on the host OS.

 

- Bret

From: deve= l@edk2.groups.io <devel@edk2.groups.io> on behalf of= Rebecca Cran via groups.io <rebecca=3Dnuviainc.com@groups.io>
Sent: Tuesday, June 29, 2021 9:42:41 AM
To: devel@edk2.groups.io <devel@edk2.groups.io>; stev= en.shi@intel.com <steven.shi@intel.com>
Subject: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work= in Linux?

 

Your Linux distribu= tion should have a nuget package available (e.g. https://packages.ubuntu.com/hirsute/nuget) but the EDK2 CI is designed= to use the copy of nuget installed with the edk2toolext package.

 

--
Rebecca Cran

 

On 6/29/21 9:44 AM, Steven Shi wrote:

Cran, Thanks. I’m curious whether the .pytoo= l has native Linux executable binary to run? It looks the edk2 CI framework= has more dependency in Linux than Windows.

 

 

Thanks

 

Steven Shi

Intel\IAGS\SFP\FIA (Firmware Infrastructure Auto= mation)

 

 

From: devel@edk2.groups.io <devel@edk2.groups.io> <= b>On Behalf Of Rebecca Cran
Sent: Tuesday, June 29, 2021 8:13 PM
To: devel@edk2.groups.io; Shi, Steven <steven.shi@intel.com> Subject: Re: [edk2-devel] Do the edk2 CI unit tests work in Linux?<= o:p>

 

NuGet.exe is a .NET= assembly/executable, so on Linux you'll need to install Mono (https://www.mono-project.com/).=

 

--

Rebecca Cran

 

 

On 6/28/21 7:45 PM, Steven Shi wrote:

Hello,

I’m interested in the edk2 CI unit tests(https://github.com/tianocore/edk2/tree/master/.pytool). I tested it in my local. It works well in Windows but does not work in Li= nux. It looks the NuGet in pytool only has windows version (C:\steven\unit_= test_env\Lib\site-packages\edk2toolext\bin\NuGet.exe) but not support the L= inux. Below is my detail test steps. Do the edk2 CI unit tests work in Linux?

 

  1. Windows :

c:\steven>py -m venv unit_test_env

c:\steven>cd  c:\steven\edk2

c:\steven\edk2>c:\steven\unit_test_env\Scripts\= activate.bat

(unit_test_env) c:\steven\edk2>pip install --up= grade -r pip-requirements.txt

(unit_test_env) c:\steven\edk2>stuart_setup -c = .pytool/CISettings.py TOOL_CHAIN_TAG=3DVS2019

(unit_test_env) c:\steven\edk2>stuart_update -c= .pytool/CISettings.py TOOL_CHAIN_TAG=3DVS2019

(unit_test_env) c:\steven\edk2>edksetup.bat

(unit_test_env) c:\steven\edk2>edksetup.bat Reb= uild

(unit_test_env) c:\steven\edk2>stuart_ci_build = -c .pytool/CISettings.py TOOL_CHAIN_TAG=3DVS2019 -a X64,IA32 -t DEBUG --ver= bose

…

PROGRESS - Overall Build Status: Success

SECTION - Summary

PROGRESS - Success

 

  1. Linux:

jshi19@ub2-uefi-b01:~/wksp_efi$ python3 -m venv un= it_test_env

jshi19@ub2-uefi-b01:~/wksp_efi$ source unit_test_e= nv/bin/activate

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk= 2-2$ pip install --upgrade -r pip-requirements.txt

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk= 2-2$ make -C BaseTools/

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk= 2-2$ stuart_setup -c .pytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5=

(unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk= 2-2$ stuart_update -c .pytool/CISettings.py TOOL_CHAIN_TAG=3DGCC5

SECTION - Init SDE

WARNING - Using Pip Tools based BaseTools

SECTION - Loading Plugins

SECTION - Start Invocable Tool

SECTION - Initial update of environment=

UpdatingWARNING - [SDE] = Failed to fetch NugetDependecy: edk2-acpica-iasl@20200717= .0.0: [Nuget] We failed to install this version 20200717.0.0 of edk2-ac= pica-iasl

WARNING - [SDE] Failed t= o fetch NugetDependecy: mu_nasm@2.15.05: [Nuget] We failed = to install this version 2.15.05 of mu_nasm

. Done=

SECTION -       Upda= ted/Verified 3 dependencies

SECTION - Second pass update of environment

UpdatingWARNING - [SDE] Failed to fetch NugetDepen= decy: edk2-acpica-iasl@20200717.0.0: [Nuget] We failed to install this versi= on 20200717.0.0 of edk2-acpica-iasl

WARNING - [SDE] Failed to fetch NugetDependecy: mu_nasm@2.15.05: [Nuget] We failed to install this version 2.15.05 of = mu_nasm

. Done

SECTION -       Upda= ted/Verified 3 dependencies

ERROR - We were unable to successfully update 2 de= pendencies in environment

SECTION - Summary

ERROR - Error

 

 

 

 

Thanks

 

Steven Shi

 

 

 

 

 

 

 

--_000_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_-- --_004_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_ Content-Type: image/png; name="image001.png" Content-Description: image001.png Content-Disposition: inline; filename="image001.png"; size=195; creation-date="Fri, 02 Jul 2021 07:23:16 GMT"; modification-date="Fri, 02 Jul 2021 07:23:16 GMT" Content-ID: Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAAisAAAACCAYAAACZkpz/AAAAAXNSR0IArs4c6QAAAAlwSFlzAAAO xAAADsQBlSsOGwAAABl0RVh0U29mdHdhcmUATWljcm9zb2Z0IE9mZmljZX/tNXEAAABDSURBVFhH 7dAxEQAgDACxDijC/4ACDOCChYkWGwx5BX9pY66bVSdEgAABAgQIEPhQoGXWurH7h2+WCBAgQIAA AQLxAIkkDVkDoC+rAAAAAElFTkSuQmCC --_004_DM4PR11MB5549B18179F547BC9E39F1368C1F9DM4PR11MB5549namp_--