From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx0b-002e3701.pphosted.com (mx0b-002e3701.pphosted.com [148.163.143.35]) by mx.groups.io with SMTP id smtpd.web10.11656.1607072603468714352 for ; Fri, 04 Dec 2020 01:03:23 -0800 Authentication-Results: mx.groups.io; dkim=fail reason="body hash did not verify" header.i=@hpe.com header.s=pps0720 header.b=XTZbb9Cy; spf=pass (domain: hpe.com, ip: 148.163.143.35, mailfrom: prvs=0607174a9d=daniel.schaefer@hpe.com) Received: from pps.filterd (m0134424.ppops.net [127.0.0.1]) by mx0b-002e3701.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 0B492APP005662; Fri, 4 Dec 2020 09:03:10 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=subject : to : references : from : cc : message-id : date : in-reply-to : content-type : content-transfer-encoding : mime-version; s=pps0720; bh=yfwkKU6zs0RDiEAM5zOvFepU88urSYvzWBYezkUjTEo=; b=XTZbb9Cyv/1Izv+74J3bYf7E+vSdceXIApU9SRRb08G7cjFXMmbj+CRR21nKpdO7BhnM AM1bXrCeFtrCPVIkwGrUWOi6rB6agzFArGjc8Vt0+YaLNcXXejjLLP/as3axSlswPwb1 1r2SrWzsvtEakCvs3t/h3MtWaLGfW0fn8iyCsdDwJZ4tT3NWzTAWYqVbGeM84rkpfE3E 1pC5FaJKtpo2J58jb0USK5KDGM/AL3NJGq9yrQl5HthvnHL3oHB5CIf0n4KGFTc6rHLH v77LhQXv9pCadVy+bIWY9R2VQTGw5zL9bNy3T0oJ4j+sS20Nl7BQesCiyWBxPYGuH9lx Rw== Received: from g2t2352.austin.hpe.com (g2t2352.austin.hpe.com [15.233.44.25]) by mx0b-002e3701.pphosted.com with ESMTP id 357frj8yxy-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 04 Dec 2020 09:03:10 +0000 Received: from G2W6311.americas.hpqcorp.net (g2w6311.austin.hp.com [16.197.64.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by g2t2352.austin.hpe.com (Postfix) with ESMTPS id EBAF3A7; Fri, 4 Dec 2020 09:03:08 +0000 (UTC) Received: from G9W8677.americas.hpqcorp.net (16.220.49.24) by G2W6311.americas.hpqcorp.net (16.197.64.53) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 4 Dec 2020 09:03:08 +0000 Received: from G9W9210.americas.hpqcorp.net (2002:10dc:429b::10dc:429b) by G9W8677.americas.hpqcorp.net (2002:10dc:3118::10dc:3118) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 4 Dec 2020 09:03:08 +0000 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (15.241.52.10) by G9W9210.americas.hpqcorp.net (16.220.66.155) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Fri, 4 Dec 2020 09:03:08 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=X15slNFNnNxzW67SOjsk4uHpSQTIM1Z7QBMr2u4YMh2HdwZRgBakEDiCxOCEPeidHz+jXKlCUc+Ix8qkVGXqnPgMuLkOsh+IjL9IXRpi2VYx5PjimXFwcARyNcFP15pOUnDS39Eor1a9hiHzdJGKtGlqP2Jftyar0PW90BmBjbkh2Sfbz/yu20tqXlgfzlZP2BU3K7XY0iMGxcOpbsHFT2GhQxlq0b6bPvszlhL7CWLmY248sIrq+A4V+w1pjT3+4kP5vvt6rqjL8xWKw9jWkngdR5KDvLmN3memmw1Ni3uGujvpWJvlmG+RfXxaR5gkDhKyFRA7Vcd/ORXH0ppuxQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IYBkIM3N7Xqc2UzdgUd1F/v6BETpbLHVZtkekyWFfc8=; b=Q5d6r91PwiQSxfzMWvVNlyfSXFwxJqSq+jb52An6ts/kUJ2u2CXytXtk53ByDVdjtK7VXW7K7+N4YyH2i4gREDwPSTIO6GboL5QKbrRAjtsCOUQUyLzJB9dkW7kuAIIQenf2U9cxNkvurVE7APVon4fh/5Tk8ksqBVoGsuaqFBLUUddMQJGS+hadvYYVpz7LBCG9aqnJffcrW+/F5KmdPp8IEu96fwR2N5gQ20Uj3L9shoygpvEz0IDWGgTf9iRPPDt2fXpqeWVRoaEPpiVxjmEVF+RKBIoJMTyhtzcLxWdtYWR3p4SLnup5fohuBF4WhLJTKz1gAUx74kDluuYOWg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hpe.com; dmarc=pass action=none header.from=hpe.com; dkim=pass header.d=hpe.com; arc=none Authentication-Results: apple.com; dkim=none (message not signed) header.d=none;apple.com; dmarc=none action=none header.from=hpe.com; Received: from DF4PR8401MB0444.NAMPRD84.PROD.OUTLOOK.COM (2a01:111:e400:760d::23) by DF4PR8401MB1289.NAMPRD84.PROD.OUTLOOK.COM (2a01:111:e400:7611::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3632.21; Fri, 4 Dec 2020 09:03:07 +0000 Received: from DF4PR8401MB0444.NAMPRD84.PROD.OUTLOOK.COM ([fe80::691c:7962:6e56:c91f]) by DF4PR8401MB0444.NAMPRD84.PROD.OUTLOOK.COM ([fe80::691c:7962:6e56:c91f%8]) with mapi id 15.20.3632.021; Fri, 4 Dec 2020 09:03:07 +0000 Subject: =?UTF-8?B?UmU6IOWbnuWkjTogW2VkazItZGV2ZWxdIE11bHRpdGhyZWFkZWQgY29tcHJlc3Npb24gd2l0aCBMWk1BMg==?= To: , References: <9ebc277a-4acd-f567-cc08-fa076e4a5766@redhat.com> <16c68ee6-19a7-1446-719d-3553a2df842e@redhat.com> <00a201d6c9e5$1c2949d0$547bdd70$@byosoft.com.cn> From: "Daniel Schaefer" CC: Laszlo Ersek , "Lin, Derek (HPS SW)" , "Bret.Barkelew@microsoft.com" , Message-ID: <61a0f744-9167-33cf-b4ed-b39b6456e9e2@hpe.com> Date: Fri, 4 Dec 2020 17:02:53 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 In-Reply-To: <00a201d6c9e5$1c2949d0$547bdd70$@byosoft.com.cn> X-Originating-IP: [15.211.146.34] X-ClientProxiedBy: SG2PR06CA0156.apcprd06.prod.outlook.com (2603:1096:1:1f::34) To DF4PR8401MB0444.NAMPRD84.PROD.OUTLOOK.COM (2a01:111:e400:760d::23) X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [10.10.6.166] (15.211.146.34) by SG2PR06CA0156.apcprd06.prod.outlook.com (2603:1096:1:1f::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3632.17 via Frontend Transport; Fri, 4 Dec 2020 09:03:03 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 79931435-40b7-49d7-4779-08d898336a7f X-MS-TrafficTypeDiagnostic: DF4PR8401MB1289: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:6430; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 47f5v/Do88hJ0IbesDV3qLsN99B8euWsB/7TLfsUNvhoZ3mvTYlgZKFULVD+m3Tp0uR3MygLoRC4hWGfcPPcD0GicxvAnjrOMBCZ6UoEdC4TKweXg+BhvsjPHMJyg416DZjTR6C7C0Eh0KEEVBeac5hpFuzlJWJq+eyqwkIwPpwfBIgk/v6kNdxe4jS1pgYRyXVMewdXwrumsOU65CUYtz53IxcjrkTVxPywkfhAgWj2qaZgtOZSc9cIt5ukT5LLSDKjdBR2EKbot50n1WJlJidRpmYVSIMUw8VoV/iyFEyCIn0lOPH/iStjsVMXcI54BnFNsc9R/nauUemm1Y6n+Nks7muCnW+NUGr7PGmWucFp+a3raMEvU7u3s8eBW/4iWeHhxLZMzLk/OC3uVI8SNY3e/1Vpxf0WXaQsZyKRGg4DHli7nv/tfNv2hdelcNu9hNcYUAFQAC73gXSfFvP5JY21UhxRpGiib6XKnusl8BdoK9EZ4XfSrQy6XYON+fX/ X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DF4PR8401MB0444.NAMPRD84.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(346002)(366004)(136003)(396003)(376002)(39860400002)(52116002)(66556008)(6666004)(26005)(66476007)(5660300002)(956004)(16526019)(186003)(4326008)(224303003)(86362001)(44832011)(54906003)(316002)(16576012)(2616005)(31686004)(966005)(8936002)(53546011)(83380400001)(66946007)(478600001)(2906002)(31696002)(36756003)(6486002)(45980500001)(43740500002);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData: =?gb2312?B?TFdxNGl1d1lLU1BFUktDZlIrK1A2dHdiTmh3OWM5aHQ0Z0R4REQrYUxidThv?= =?gb2312?B?R0RsdjJleERrTnFONjNBQWJydWtNNzU0aWJEeUhzQ0poRTN6S1F5cmc0RXlH?= =?gb2312?B?SjMrZW1oTGhrVy8wSGJIc1U3ZG9XQm91cDhqMHJ0U0dINmdEQTVzWFdwdzl2?= =?gb2312?B?c0hEN2tIb2EvdlNFb1ZOWmV0V3luc1JWalRKS3FLT2trTFZrQitqSUwwVWFo?= =?gb2312?B?S3oyY29rWFM3OUMxdm5SdEI1cGhiYk1OY1BSRTVDdHNxQXZWOXplUHRhOGw3?= =?gb2312?B?NnhYRm5jWWNmN2tlK09JckJndk4wTER2amFqWk1LZVduSVZtL012L2I1SnRU?= =?gb2312?B?c09DMjQ1MmsrMkJNT3lHUk1Ja2U0KzZINkY4cDlaUEpmMFFuSkRqSHBlSDl3?= =?gb2312?B?MGxWTWVNSzU0a2dCbzR5aXp3Zk9Uc1BqdTNJUWVLZlN5eTl6MTFOUVdFcHd0?= =?gb2312?B?M0ZzMHQvUG02bDhqYjM2UWlhYTR6R1RkOFllcW5GV3d3QWZWRzBBcUV6dzZK?= =?gb2312?B?MmIwM3duWVgrcW5SbHhuOVRKdU1TcE1wSFEwUS9PYnZIK2IxNC9haWI5Vk90?= =?gb2312?B?WHQ3bHErTVY2VmNleWR6Wk5ZZUhVQ2xScENPQ2dsUDRhU25RMXBOdkN1aEdM?= =?gb2312?B?d3pOd04zUkV4enc3UkpJRkp1aFRTVzNoa3lueHhsSVBic3NPbURsZGx4R3lw?= =?gb2312?B?WENWRVpHYmhIMTU2NDdXOS95bEtWcG1uVUNxTGloaXUxU1ZMWjN3eDhvR3hL?= =?gb2312?B?YXZ1MmVJSXBNTmkyZFJubld4VUI4Z2pPeXZhOGpCemtPNmxZS2tsa1k3aGs5?= =?gb2312?B?M204dzBaNEdaZ2FrWGJibWpJNVlmMU1zdCtEUjkzRUYzM0UrbWxXWW5xNW81?= =?gb2312?B?SHFGenBZdWRxSWZJSU11ekpXb1NneGZhQno2SmJPSURUZEM5dkplMnl6QU9K?= =?gb2312?B?c2JDQ2EydE81LzVXZ2FGc2RobWxKZlFaZFo3ZHByY3B1Mi9jbzVOcW0zZFdN?= =?gb2312?B?M2NzZG5KdmthV3BCaEQrWi8vS1pMdGNTeW1tL3JHYUlVYVg4TExLQ0g1Qmdi?= =?gb2312?B?UmwvbEZHaHVsSy9RbjJFSnRBSGd0eDN3SlkxcDhwbk9sbzJqejZrQU1rNi9I?= =?gb2312?B?RWhEeW8wQzBqKzl1a0Q4aVV4Rnp2NVlNVkw1dDkzK1FCcnNRbnNrRSs1WUdB?= =?gb2312?B?dTlQSUZBVWF3WWdrL1FPb2s4VWNOaGw5ZkZqN3ZLVlJsd29TZGJHcTA4QURq?= =?gb2312?B?RXNtZzh3R3Y3Qk9DUWZ1cVU0TlV6VEk3N3hmbXBRL20xK0J6QnN3Vm5BVXNj?= =?gb2312?Q?iEYqTL3KYDIcLyCxTkepyDcUOGfJT5QZpL?= X-MS-Exchange-CrossTenant-Network-Message-Id: 79931435-40b7-49d7-4779-08d898336a7f X-MS-Exchange-CrossTenant-AuthSource: DF4PR8401MB0444.NAMPRD84.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Dec 2020 09:03:07.2294 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 105b2061-b669-4b31-92ac-24d304d195dc X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: BhbV2MUs6bCYscSFULdCzy3y91f9O4/m0JwGTDiQowb540Ah6EjSxP45UZrkO1PDQBRp4ye8UkRwudICd5KOWQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DF4PR8401MB1289 X-OriginatorOrg: hpe.com X-Proofpoint-UnRewURL: 0 URL was un-rewritten MIME-Version: 1.0 X-HPE-SCL: -1 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.312,18.0.737 definitions=2020-12-04_03:2020-12-04,2020-12-04 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 lowpriorityscore=0 mlxlogscore=999 impostorscore=0 spamscore=0 priorityscore=1501 mlxscore=0 suspectscore=0 malwarescore=0 bulkscore=0 phishscore=0 adultscore=0 clxscore=1015 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2012040054 X-MIME-Autoconverted: from 8bit to quoted-printable by mx0b-002e3701.pphosted.com id 0B492APP005662 Content-Type: text/plain; charset=gbk; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 12/4/20 10:28 AM, gaoliming wrote: > Daniel=A3=BA > Yes. New guided section extractor matches new compression algorithm. Good. I see that we use version 18.05 of the LZMA SDK, while there's alre= ady 19.00: https://www.7-zip.org/sdk.html Should we use this opportunity to update? > For the compression algorithm, its compression ratio, compression perfo= rmance, > the decompression performance, the decompression taken memory are all > required to be considered. For compression ratio and performance, see my earlier emails. Summary: Compression ratio is basically the same. Performance is also the same, except when using 4 threads it compresses o= ur main image in just 40% of the time. Some images don't compress as well, t= hey take the same time to compress. For decompression memory usage I used the xz commands on Linux again: # LZMA1 $ /usr/bin/time -v unxz testfile.lzma Maximum resident set size (kbytes): 10228, 10492, 10460, 10200, 10244 =3D= > 10324.8 # LZMA2 $ /usr/bin/time -v unxz testfile.xz Maximum resident set size (kbytes): 10456, 10460, 10224, 10212, 10548 =3D= > 10380.0 Result: Basically the same. I don't know how I would measure this in EDK2. Any ideas? From the manpage of xz and LZMA authors: > LZMA2 is an updated version of LZMA1 to fix some practical issues of = LZMA1. > Compression speed and ratios of LZMA1 and LZMA2 are practically the= same. > LZMA2 is better than LZMA, if you compress already compressed data. Here's a benchmark which compares both of them, among others: https://stephane.lesimple.fr/blog/lzop-vs-compress-vs-gzip-vs-bzip2-vs-lz= ma-vs-lzma2xz-benchmark-reloaded/ Same result: They're basically the same. > Thanks > Liming >> -----=D3=CA=BC=FE=D4=AD=BC=FE----- >> =B7=A2=BC=FE=C8=CB: bounce+27952+68292+4905953+8761045@groups.io >> =B4=FA=B1=ED Laszlo Ers= ek >> =B7=A2=CB=CD=CA=B1=BC=E4: 2020=C4=EA12=D4=C24=C8=D5 7:35 >> =CA=D5=BC=FE=C8=CB: Schaefer, Daniel ; devel@= edk2.groups.io >> =B3=AD=CB=CD: Lin, Derek (HPS SW) >> =D6=F7=CC=E2: Re: [edk2-devel] Multithreaded compression with LZMA2 >> >> On 12/03/20 13:11, Schaefer, Daniel wrote: >>> >>> From: Laszlo Ersek >>> Sent: Thursday, December 3, 2020 18:24 >>> To: devel@edk2.groups.io ; Schaefer, Daniel >> >>> Cc: Lin, Derek (HPS SW) >>> Subject: Re: [edk2-devel] Multithreaded compression with LZMA2 >>> >> >>> "xz -T" works by splitting the input into blocks, and it generates a >>> multi-block compressed output. >>> >>> Yes, that's correct. >>> >>>> I'm unsure if the current LZMA >>> decompressor that runs inside the firmware (=3D guided section extrac= tor) >>> copes with multi-block input. >>> >>> I think you're right that it doesn't. But we can make the guided sect= ion >> extractor use that same algorithm(LZMA2) and assign it a different GUI= D, >> right? >> >> I guess so... >> >> Thanks >> Laszlo