From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received-SPF: Pass (sender SPF authorized) identity=mailfrom; client-ip=40.107.82.95; helo=nam01-sn1-obe.outbound.protection.outlook.com; envelope-from=jerecox@microsoft.com; receiver=edk2-devel@lists.01.org Received: from NAM01-SN1-obe.outbound.protection.outlook.com (mail-eopbgr820095.outbound.protection.outlook.com [40.107.82.95]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ml01.01.org (Postfix) with ESMTPS id 1AD6A2117D76B for ; Wed, 5 Dec 2018 11:09:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Gk0JuC2Z7EjpDRTthVLYC9LRFsHUmPiqn9YwCpqcM9s=; b=KNmUx/0bDQDv+h+7HsFwXP8OBFYN/3dO7WBZw2YyszU4nd+9s45bo6UcCapSa6wqFdecm9jdWumUIS3mqHdQEEXLaQmz6SoZu5dpVNxM4pgqJsVOoNfPof//NGCzp3w1qSD2W2YZ7LAEEOkGhBFeay9fAz05m+4RRzIZlKchyuA= Received: from MWHPR21MB0176.namprd21.prod.outlook.com (10.173.52.22) by MWHPR21MB0767.namprd21.prod.outlook.com (10.173.51.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.1425.1; Wed, 5 Dec 2018 19:09:10 +0000 Received: from MWHPR21MB0176.namprd21.prod.outlook.com ([fe80::5dea:4f10:1303:63f4]) by MWHPR21MB0176.namprd21.prod.outlook.com ([fe80::5dea:4f10:1303:63f4%10]) with mapi id 15.20.1425.006; Wed, 5 Dec 2018 19:09:10 +0000 From: Jeremiah Cox To: Laszlo Ersek , "Brian J. Johnson" , stephano CC: "edk2-devel@lists.01.org" Thread-Topic: [edk2] [edk2-announce] Research Request Thread-Index: AQHUfEnTtPiE/WSrPUuPSmMH8XYInKVZXZIAgAAUkYCACRyb4IABGQiAgACXlACAAN0iAIAAfBiggAA6yACAADOcsIAAkcQAgAbFbXOAAacWAIABkdNw Date: Wed, 5 Dec 2018 19:09:10 +0000 Message-ID: References: <4330857f-4e27-632f-6f82-6fc6ec636b2e@linux.intel.com> <76cb4d25-7eff-b19b-0dd5-2fcc3a1e7d82@redhat.com> <5c92dfcf-f98c-9828-5608-fd7d74fe3b3a@redhat.com> <838b16fd-9821-c64c-19f4-aafb63140b6c@redhat.com> <0b2ce1b0-93ab-aef2-d192-23fd84024b70@redhat.com> In-Reply-To: <0b2ce1b0-93ab-aef2-d192-23fd84024b70@redhat.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Enabled=True; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SiteId=72f988bf-86f1-41af-91ab-2d7cd011db47; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Owner=jerecox@ntdev.microsoft.com; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SetDate=2018-12-05T19:09:10.8343304Z; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Name=General; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Application=Microsoft Azure Information Protection; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Extended_MSFT_Method=Automatic; Sensitivity=General x-originating-ip: [2001:4898:80e8:9:b283:55b0:943b:8745] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; MWHPR21MB0767; 6:c0Lywd1md8zQyyyA/zlRAmVmG0DsB6Yqjqd5KQGKzAJtoyht18V69c+IvC0pcgnlHxy7JBF1xcmRW0hQvOmwC0xGsjaC4seHjlmVE+PHx8yi5MKFX6pYGX8izr49v1DS1AGkRgKWudr71NZAktZUmjHNVFHx9IMbQv/n/1xHDdLgeXXHszVLyPW1HqDXcWBAi+RkhqZzD/KOizyn5QbgF2uGSTV5S8csYUJAZXM1mcHXh/RIlwqNc/VvSMNFCULaT1/61kfGUybUY5nkBUDRT6eldaMYXCQonmcCPlVkcA6F1VRxCLfGeEZbnloo44J4e5YlF5i1/ZsMJHl2k52A/va7z81KUkn/K60+7/5N2dk7PYEsagXCDe5YNzVbK++3Az+xU8bpvgjjfOBFVK6va98htL8vjQOOoaUM4GMT85cpu1RGn0WvICEa79asEoaD1FdJZprBgUy5vaWMQ99QUQ==; 5:4yBw8dpsnMQHjocJk76rh8VFCx+OVRXrL17P51R/tdAN2c33/H3ILQlEmKJEGFgWISYQLGL9EGW5jCCQ5Hb9/acmWsKZcmWfgpNR+OqKvj4u9ixrT/luTU829I5qwvzCD0bgwiDo4eJt/vnWZyh+9V/fzwfESJF/djr7XivwN6M=; 7:V/jN9JCWeZRpMyDssfb8Uief67KzumGU3esJxrXrox/6Yd7aEmE5CT/Sej5sQFtKtWHhynJkt2dOmNMVbSnw/aMwA6DnKBxr/BJueDQ8RUubG8Z8u5rETdypOh/Yc0CAXEuImbzDY3mps0m8hDKMMg== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 27ab84bd-fb24-468b-3b22-08d65ae52354 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(4618075)(2017052603328)(7193020); SRVR:MWHPR21MB0767; x-ms-traffictypediagnostic: MWHPR21MB0767: x-ms-exchange-purlcount: 7 authentication-results: spf=none (sender IP is ) smtp.mailfrom=jerecox@microsoft.com; x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(3230008)(999002)(6040522)(8220035)(2401047)(5005006)(8121501046)(3231463)(944501520)(4982022)(2018427008)(10201501046)(93006095)(93001095)(3002001)(6055026)(148016)(149066)(150057)(6041310)(20161123564045)(20161123562045)(20161123558120)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(201708071742011)(7699051)(76991095); SRVR:MWHPR21MB0767; BCL:0; PCL:0; RULEID:; SRVR:MWHPR21MB0767; x-forefront-prvs: 08770259B4 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(39860400002)(376002)(136003)(396003)(346002)(199004)(189003)(13464003)(966005)(316002)(478600001)(10290500003)(6116002)(25786009)(71200400001)(71190400001)(4326008)(5660300001)(22452003)(102836004)(6246003)(86362001)(575784001)(2906002)(256004)(14444005)(5024004)(93886005)(53546011)(86612001)(6506007)(76176011)(46003)(33656002)(14454004)(486006)(476003)(7696005)(74316002)(105586002)(10090500001)(53936002)(106356001)(55016002)(81156014)(8990500004)(6436002)(8936002)(99286004)(110136005)(186003)(68736007)(8676002)(6306002)(81166006)(97736004)(305945005)(446003)(11346002)(7736002)(229853002)(9686003); DIR:OUT; SFP:1102; SCL:1; SRVR:MWHPR21MB0767; H:MWHPR21MB0176.namprd21.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: L6kodCTbGGjXc7RgIs/IV2Y+SBcpRSYs7Ogvz96VAOthdj6+9UpbtTAITgcA4e+LYTkb1nESeAhCIml3GGJg2/vw+9i3/yQ71jxO/Em8yIKCVpYs9RlnXB/mpkKaGFWVb0pYqNmF223mMQI2yXpZQgpz2/DKNEaNSYTmHnZhn55tv5qSKU5d9E29IMxhNSXcKmRWBaK/nDs4W7rJ4/2Xi6q7Rnu+H654B7oHmVq+4ou7H62JgzPCT7tseIji0zJO3a5dtCKD4QkXfe+q5FW2/5g+3Kg8vnjyf92+CvPs5pv9V9Q7TJxgac3b1ysP+ikdERaDbszc4mJ2Vt0PSVdMEtjFTQ6We/0ANeM2E1jmfw0= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: 27ab84bd-fb24-468b-3b22-08d65ae52354 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Dec 2018 19:09:10.4085 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR21MB0767 Subject: Re: [edk2-announce] Research Request X-BeenThere: edk2-devel@lists.01.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: EDK II Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Dec 2018 19:09:13 -0000 Content-Language: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi Laszlo, Regarding "comprehensive backup/archival functionality that is core to the = service itself", are you speaking more to GitHub's internal metadata verbos= ity (e.g. not losing PR details when branches and repos are deleted), GitHu= b's backup strategy to prevent data loss, or the ability to export all of t= his data from GitHub? I believe your PR experiments are exploring the first point about metadata = verbosity. We've done some experimentation of our own and have found the v= erbosity acceptable for us. GitHub's internal backup strategy is published: https://help.github.com/articles/github-security/#file-system-and-backups=20 Regarding export, I discovered GitHub has a preview REST API dedicated to b= ackup & archival. GitHub will package up all of our metadata into a big ta= rball: https://developer.github.com/v3/migrations/orgs/=20 At a glance it appears to be simple to use and comprehensive. I trust that any so called "web bugs" in GitHub emails are not malicious. = =20 Thanks, Jeremiah -----Original Message----- From: Laszlo Ersek =20 Sent: Tuesday, December 4, 2018 10:27 AM To: Jeremiah Cox ; Brian J. Johnson ; stephano Cc: edk2-devel@lists.01.org Subject: Re: [edk2] [edk2-announce] Research Request On 12/03/18 18:22, Jeremiah Cox wrote: > Laszlo, > > Did you want to summarize your experience of our GitHub experiments? That's right. I'll provide a summary below. > From your comments on the PRs, it sounded like the email =20 > notifications did not provide the level of detail that you desire for =20 > archival purposes. That's correct. > Stephano's email suggested that as long as we have an alternative=20 > mechanism to archive all metadata, that may still be acceptable. Indeed, that's what I think as well. > I propose that=20 > https://na01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgithu > b.com%2Fjosegonzalez%2Fpython-github-backup&data=3D02%7C01%7Cjerecox > %40microsoft.com%7C39e7247ecd1946a67e9c08d65a160e80%7C72f988bf86f141af > 91ab2d7cd011db47%7C1%7C0%7C636795448114734464&sdata=3DOoS6nyB83BGn%2 > Bg%2BNnSA4AAsNqb3e6xjpHmR7LUvU98c%3D&reserved=3D0 > may suffice. I didn't miss it when you first recommended this utility, in: https://na01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgithub= .com%2Flersek%2Fedk2%2Fpull%2F2%23issuecomment-443066812&data=3D02%7C01= %7Cjerecox%40microsoft.com%7C39e7247ecd1946a67e9c08d65a160e80%7C72f988bf86f= 141af91ab2d7cd011db47%7C1%7C0%7C636795448114734464&sdata=3Dedt3z5c7%2BD= NTr%2BtkvHpUkEqCppG44B13WrvUkgPI0kY%3D&reserved=3D0 I didn't respond explicitly because, when you made that suggestion, I had a= lready stated on the edk2-devel list that external tools that aren't a core= part of the service wouldn't cut it, for me anyway: https://na01.safelinks.protection.outlook.com/?url=3Dhttp%3A%2F%2Fmid.mai= l-archive.com%2F76cb4d25-7eff-b19b-0dd5-2fcc3a1e7d82%40redhat.com&data= =3D02%7C01%7Cjerecox%40microsoft.com%7C39e7247ecd1946a67e9c08d65a160e80%7C7= 2f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636795448114734464&sdata=3DL4= eofdxURPR1HOy60ZcJW9KgE1ByPxIi09Y9slRbZ5w%3D&reserved=3D0 On 11/27/18 13:53, Laszlo Ersek wrote: > GitHub has extremely good availability. I doubt that any hack we could=20 > come up with (and that we'd have to run ourselves, elsewhere), could=20 > muster the same service level. This means that sooner or later our=20 > mirroring hack would go down, while GitHub would stay up, and then=20 > we'd start losing updates to our "mirror". > > The offline & full coverage audit trail has to be generated by a core=20 > part of the service. I don't know who "josegonzalez" is, whom he works for, what his interests a= re, what kind of support we can get from him (for his software), where and = how we should run his software, what SLA we could get from the organization= that actually runs "python-github-backup" for us, and so on. To repeat, it suffices if we get *at least one* of (a) comprehensive email notifications, (b) comprehensive backup/archival functionality that is core to the service itself. At this point, GitHub seems to provide zero of these. (I'll also repeat that I agree that GitHub provides a *lot* of important an= d useful functionality in other areas. To me those areas are not interchangeable.) OK, so let me summarize my points, from: - this thread, - https://na01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgithub= .com%2Flersek%2Fedk2%2Fpull%2F1&data=3D02%7C01%7Cjerecox%40microsoft.co= m%7C39e7247ecd1946a67e9c08d65a160e80%7C72f988bf86f141af91ab2d7cd011db47%7C1= %7C0%7C636795448114734464&sdata=3DxFMUbMuuj6FKA2zPMrKZ0MlSHeDIhYc0LDYpM= Jj92wo%3D&reserved=3D0 - https://na01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgithub= .com%2Flersek%2Fedk2%2Fpull%2F2&data=3D02%7C01%7Cjerecox%40microsoft.co= m%7C39e7247ecd1946a67e9c08d65a160e80%7C72f988bf86f141af91ab2d7cd011db47%7C1= %7C0%7C636795448114734464&sdata=3DSTndRd8YrVmWDTehLH2R7RlduAXmC7x6v%2Fv= gCxUR0%2BU%3D&reserved=3D0 On the plus side: - It is possible to enable email notifications about one's own actions. - It is possible to attach comments to specific lines of a patch. - The "commits" button at the top gives a complete view, with subject line, commit message, code, and (optionally) review comments displayed. - Rejecting a pull request does not make the HEAD of the proposed topic branch disappear; the commit reference from the PR keeps working. - This remains true even if the originator (pull requester) repository is removed. On the minus side: - I couldn't attach comments to the commit message (in particular to specific lines of the commit message). As a stop-gap measure, I could make a general comment and refer to the commit message. - When making a comment on a patch, it is unclear how "add single comment" differs from "start a review". - Email notifications lack context. The notification does not name the commit (the subject line of the patch is not quoted, just the title of the PR), which is a problem if a series consists of multiple patches. In addition, trailing code context (that follows the review comment being sent out in email) is not cited in the email, only the preceding code context is. The commit message is also not quoted in the email. - The email notifications contain "web bugs". My MUA warns that it blocks remote content while displaying these emails. The emails should be self-contained. - Some questions remain unanswered about longevity of PR branches whose originating repos disappear: - How can a CLI user fetch the orphaned branch into a local clone of his/hers? The GitHub WebUI does not provide a "remote URL" for this. - Do such branches survive "git gc" (garbage collection) that GitHub surely runs periodically? - What happens if not only the originating repo is deleted, but the pull requestor's user account too? I don't insist that others agree with me that these are "minuses"; I'm expr= essing my personal impressions. Furthermore, I have no idea at all whether = other web-based development tools perform better in these areas. Thanks! Laszlo