Instructions for running EDK2 CI on an Ubuntu system? ("System.TypeLoadException: Failure has occurred while loading a type.")

Instructions for running EDK2 CI on an Ubuntu system? ("System.TypeLoadException: Failure has occurred while loading a type.")

[rebecca]

Is there any guide to getting the CI system (e.g. .pytool/CISettings.py) 
working on an Ubuntu system?

I ran "pip install -r pip-requirements.txt", then installed mono-runtime 
to get stuart_setup working, and have then installed 
libmono-system-componentmodel-composition4.0-cil, 
libmono-system-componentmodel-dataannotations4.0-cil, 
libmono-system-net-http4.0-cil, libmono-windowsbase4.0-cil, 
libmono-microsoft-build-utilities-v4.0-4.0-cil, 
libmono-system-xml-linq4.0-cil, libmono-system-io-compression4.0-cil, 
libmono-system-data-services-client4.0-cil, and 
libmono-system-servicemodel4.0a-cil
  to try and get stuart_update working, but after all that have run into 
the following error:


DEBUG - Cleaning dependency directory for 'mu_nasm'...
DEBUG - Getting host info for host: uname_result(system='Linux', 
node='photon', release='5.3.0-23-generic', version='#25-Ubuntu SMP Tue 
Nov 12 09:22:33 UTC 2019', machine='x86_64', processor='x86_64')
INFO - Cmd to run is: mono 
/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/bin/NuGet.exe 
locals global-packages -list
INFO - ------------------------------------------------
INFO - --------------Cmd Output Starting---------------
INFO - ------------------------------------------------
INFO - Failure has occurred while loading a type.
INFO - System.TypeLoadException: Failure has occurred while loading a type.
INFO -   at NuGet.CommandLine.CommandLineParser.ExtractOptions 
(NuGet.CommandLine.ICommand command, 
System.Collections.Generic.IEnumerator`1[T] argsEnumerator) [0x0013a] in 
<f495a477196947558735199950d701a7>:0
INFO -   at NuGet.CommandLine.CommandLineParser.ParseCommandLine 
(System.Collections.Generic.IEnumerable`1[T] commandLineArgs) [0x00043] 
in <f495a477196947558735199950d701a7>:0
INFO -   at NuGet.CommandLine.Program.MainCore (System.String 
workingDirectory, System.String[] args) [0x00130] in 
<f495a477196947558735199950d701a7>:0
INFO - ------------------------------------------------
INFO - --------------Cmd Output Finished---------------
INFO - --------- Running Time (mm:ss): 00:00 ----------
INFO - ------------------------------------------------
Traceback (most recent call last):
   File "/home/bcran/.local/bin/stuart_update", line 8, in <module>
     sys.exit(main())
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/invocables/edk2_update.py", 
line 122, in main
     Edk2Update().Invoke()
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/base_abstract_invocable.py", 
line 139, in Invoke
     retcode = self.Go()
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/invocables/edk2_update.py", 
line 92, in Go
     (build_env_old, shell_env_old, _) = self.PerformUpdate()
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/invocables/edk2_update.py", 
line 62, in PerformUpdate
     (success, failure) = 
self_describing_environment.UpdateDependencies(ws_root, scopes)
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/environment/self_describing_environment.py", 
line 294, in UpdateDependencies
     return build_env.update_extdeps(shell_env)
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/environment/self_describing_environment.py", 
line 205, in update_extdeps
     extdep.fetch()
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/environment/extdeptypes/nuget_dependency.py", 
line 162, in fetch
     if self._fetch_from_cache(package_name):
   File 
"/home/bcran/.local/lib/python3.7/site-packages/edk2toolext/environment/extdeptypes/nuget_dependency.py", 
line 95, in _fetch_from_cache
     if not os.path.isdir(NugetDependency.global_cache_path):
   File "/usr/lib/python3.7/genericpath.py", line 42, in isdir
     st = os.stat(s)
TypeError: stat: path should be string, bytes, os.PathLike or integer, 
not NoneType


-- 
Rebecca Cran

Re: [edk2-devel] Instructions for running EDK2 CI on an Ubuntu system? ("System.TypeLoadException: Failure has occurred while loading a type.")

[Sean]

[-- Attachment #1: Type: text/plain, Size: 566 bytes --]

Rebecca,

I'll take a look and see if I can build up my own Ubuntu vm.  We use the Ubuntu instance provided by Azure DevOps without any issues. Here is the documentation provided for that.

Overview
https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops

and more specifically related to available tools and libraries.
https://github.com/microsoft/azure-pipelines-image-generation/blob/master/images/linux/Ubuntu1804-README.md

if you figure it out let me know as i don't want us both duplicating effort.

Thanks
Sean

[-- Attachment #2: Type: text/html, Size: 876 bytes --]

Re: [edk2-devel] Instructions for running EDK2 CI on an Ubuntu system? ("System.TypeLoadException: Failure has occurred while loading a type.")

[Sean]

[-- Attachment #1: Type: text/plain, Size: 570 bytes --]

Sorry Rebecca for the slow reply.

We have identified the issue and will be adding some minor documentation to pytool docs to help.
In short, nuget relies on new versions of mono.  Mono is not getting updated in linux distro maintained packages as fast as needed.

This resolved the issue for our Linux environments (not leveraging Azure VMs).
https://www.mono-project.com/download/stable/#download-lin-ubuntu

Please let me know how that works out for you.   This was never intended to introduce issues for local replication or other usage.

Thanks
Sean

[-- Attachment #2: Type: text/html, Size: 793 bytes --]