From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mx.groups.io with SMTP id smtpd.web12.5696.1650447144815337145 for ; Wed, 20 Apr 2022 02:32:25 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=LtaOZL4E; spf=pass (domain: redhat.com, ip: 170.10.133.124, mailfrom: osteffen@redhat.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1650447144; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ZuwfaKyd4ZUeWRkl+jgoHJ6+/ci4ocNAN6JRieKR/b4=; b=LtaOZL4EX+XViljNrO+fYgykVwYbCcQToDpqJ5YfQTKfy7vgC4lVgcHsVvOMK7sxCEJkS/ GfiUimnQ85ejFpCxWMRuWz5pA4FJpHDduAHOkc+VepBnIXb6zx76qdQ1eVIrf7/wBAenST oiNMsBmI1SpUw0XAh5+AN7PwVXtZa28= Received: from mail-wm1-f69.google.com (mail-wm1-f69.google.com [209.85.128.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-584-NxAY478MM-e5KocqF5ygRw-1; Wed, 20 Apr 2022 05:32:22 -0400 X-MC-Unique: NxAY478MM-e5KocqF5ygRw-1 Received: by mail-wm1-f69.google.com with SMTP id k66-20020a1ca145000000b003928959f8efso1680636wme.1 for ; Wed, 20 Apr 2022 02:32:22 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=ZuwfaKyd4ZUeWRkl+jgoHJ6+/ci4ocNAN6JRieKR/b4=; b=rBZBw38/Ydqm2sT1CtX2SWjW9bFcY7CQEeFmBZDFTixvMO54fOATvah7uOj0CA97Y8 uJHnPccNRe1n3gvBvWS3Kerp9Xb/2/XLoArYknIy7sy+/cnHugCbFAB4IRlxmoiy9znz BvzQ8h7aMnN9GBeZoHhmt4PJ9NYqucZkZpw19TPeFbmAD1KRISq8xzYojvLgySeWB/6z PoWO4g3IJ2XHEG1JpVeMgVK4hPSsdLNt+Gi57LdbCZlEZFoFFLiqKRqk74RukUDu123B v7A3KctbuO0aeP2EEjNQ+q9RojcFKTAgq8C63NKafuItATOoC5AlP8x6G5uEcJ/ftqcJ S+1w== X-Gm-Message-State: AOAM531BAkwd4D2YoVz44auO8n5/+vxzAItmCx01WoiRi2Br+gYBeJ+Y +CafoY9ArfCoCL7CNEkMQuipq+EvYAKH3cBtuxGh9gD40sqwxVIbecO6HC906h1q7vFf57HBKQK 2SagFYQnA63Fw9LSc75di8Ir+OTpddmDLFMZrqKUPMn9O7aNG4K4PTe6EuSauI7nMLw== X-Received: by 2002:adf:f3d1:0:b0:209:87ad:810f with SMTP id g17-20020adff3d1000000b0020987ad810fmr14599724wrp.719.1650447141461; Wed, 20 Apr 2022 02:32:21 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz+VHFWHCH9tWa6KsXQmJYxMhhBsSNb7+9xiG1yABubKTH3bMYQ1gnww/+tJrszgLMpdPWDCQ== X-Received: by 2002:adf:f3d1:0:b0:209:87ad:810f with SMTP id g17-20020adff3d1000000b0020987ad810fmr14599688wrp.719.1650447141117; Wed, 20 Apr 2022 02:32:21 -0700 (PDT) Return-Path: Received: from localhost (dslb-188-105-210-187.188.105.pools.vodafone-ip.de. [188.105.210.187]) by smtp.gmail.com with ESMTPSA id b5-20020adff905000000b0020a8781be70sm9925179wrr.12.2022.04.20.02.32.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 20 Apr 2022 02:32:20 -0700 (PDT) Date: Wed, 20 Apr 2022 11:32:19 +0200 From: "Oliver Steffen" To: devel@edk2.groups.io, ardb@kernel.org Cc: Gerd Hoffmann , Andrew Fish , Ard Biesheuvel , "Feng, Bob C" , Bret Barkelew , "Liming Gao (Byosoft address)" , Jiewen Yao , Jordan Justen , Michael Kinney , Leif Lindholm , Ray Ni , Sami Mujawar , Sean Brogan , Yuwei Chen Subject: Re: [edk2-devel] [PATCH 0/4] CI: Use Fedora 35 container for Linux jobs Message-ID: <20220420093219.2tknu3aeub5sap6l@osteffen-laptop> References: <20220419073448.165566-1-osteffen@redhat.com> <20220420073040.d3dpwzt4hwhm3hg5@sirius.home.kraxel.org> MIME-Version: 1.0 In-Reply-To: Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=osteffen@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8; format=flowed Content-Disposition: inline On 20.04.2022 11:16, Ard Biesheuvel wrote: >On Wed, 20 Apr 2022 at 09:30, Gerd Hoffmann wrote: >> >> On Tue, Apr 19, 2022 at 11:54:38PM +0200, Ard Biesheuvel wrote: >> > On Tue, 19 Apr 2022 at 09:35, Oliver Steffen wrote: >> > > >> > > PR: https://github.com/tianocore/edk2/pull/2711 >> > > >> > > Update CI, run all Linux (aka Ubuntu-GCC5) based jobs in a custom >> > > Fedora 35 container. >> > >> > Why? >> > >> > > The image provides gcc 11 from Fedora for all >> > > architectures. The external dependencies for gcc have been removed >> > > so stuart does not download them. iasl and nasm are also >> > > included in the image, but remain as ext-dep for now (CI jobs on >> > > Windows need those). >> >> ^^^ this for example. >> >> The idea is to (a) switch linux CI builds from vm images to container >> images, and (b) use our own, custom container images. >> >> This allows to roll the dependencies needed for CI into the container >> images, so there is no need to download them in CI jobs. Fixes >> temporary CI failures due to network problems and download errors. >> >> This also allows to remove any distribution-specific commands (apt-get >> for example) from CI jobs. This will be handled in the Dockerfiles used >> to build our custom container images instead. >> >> Oliver is also working on ubuntu containers, look here: >> >> > > The Dockerfiles are here: >> > > https://github.com/osteffenrh/edk2-build-images, >> >> Fedora is a bit faster on updating stuff. For example: ubuntu 22.04 >> uses gcc 11 whereas Fedora 36 uses gcc 12 (both distros are in beta >> right now). Whenever we want: >> >> (a) stick to ubuntu, or >> (b) switch to fedora, or >> (c) use both >> >> is up for debate. >> >> > > but they should, of >> > > course, then move to a repo in the Tianocore group, or something like >> > > that. The images are built automatically via GitHub Actions and then >> > > pushed to ghcr.io. >> >> That is the next question: where should we host the Dockerfiles and >> container images? >> >> For the Dockerfiles that should probably a git repo in the tianocore >> group. >> >> For the container images the obvious choices are github and azure. >> Given that microsoft owns github I'd expect both github actions and >> azure pipelines are running on the same cloud infrastructure and it >> doesn't make much of a difference whenever github or azure container >> registry is used to host container images. >> > >Thanks for the explanation. > >Please put information like this in the commit logs, rather than >assuming it will obvious to everyone without providing any background. Will do. There is a related discussion about CI and containers here: https://github.com/tianocore/edk2/discussions/2614#discussioncomment-2595253 as well as in the meeting recording attached in that post. Cheers, Oliver