public inbox for devel@edk2.groups.io
 help / color / mirror / Atom feed
* [PATCH 0/4] MdeModulePkg/BaseTools: Add Brotli algorithm support
@ 2017-03-23  2:15 Song, BinX
  2017-03-23  6:05 ` Song, BinX
  0 siblings, 1 reply; 7+ messages in thread
From: Song, BinX @ 2017-03-23  2:15 UTC (permalink / raw)
  To: edk2-devel@lists.01.org; +Cc: Gao, Liming

Brotli algorithm was released on the website https://github.com/google/brotli.
It has a little less compress ratio than Lzma, but has better decompress performance than it.
Add Brotli algorithm support, include Brotli decompression library and tool set.

Tested on:
OS: Windows
Arch: IA32/X64
Platform: Nt32Pkg
ToolChain: VS2015x86
Target: Release

OS: Ubuntu
Arch: IA32/X64
Platform: OvmfPkgIa32.dsc/OvmfPkgX64.dsc
ToolChain: GCC5
Target: Release

Cc: Liming Gao <liming.gao@intel.com>
Contributed-under: TianoCore Contribution Agreement 1.0
Signed-off-by: Bell Song <binx.song@intel.com>

Bell Song (4):
  MdeModulePkg: Copy Brotli algorithm 3rd party source code for library
  MdeModulePkg: Add Brotli algorithm decompression library
  BaseTools: Copy Brotli algorithm 3rd party source code for tool
  BaseTools: Add Brotli algorithm tool

 BaseTools/BinWrappers/PosixLike/Brotli             |    29 +
 BaseTools/BinWrappers/PosixLike/BrotliCompress     |    42 +
 BaseTools/Conf/tools_def.template                  |     6 +
 .../Source/C/BrotliCompress/BrotliCompress.bat     |    48 +
 BaseTools/Source/C/BrotliCompress/GNUmakefile      |    43 +
 BaseTools/Source/C/BrotliCompress/LICENSE          |    19 +
 BaseTools/Source/C/BrotliCompress/Makefile         |    60 +
 BaseTools/Source/C/BrotliCompress/README.md        |    26 +
 BaseTools/Source/C/BrotliCompress/ReadMe.txt       |     2 +
 .../Source/C/BrotliCompress/common/constants.h     |    47 +
 .../Source/C/BrotliCompress/common/dictionary.c    |  9474 ++++++++++++++++
 .../Source/C/BrotliCompress/common/dictionary.h    |    29 +
 BaseTools/Source/C/BrotliCompress/common/port.h    |   107 +
 BaseTools/Source/C/BrotliCompress/common/types.h   |    58 +
 BaseTools/Source/C/BrotliCompress/dec/bit_reader.c |    48 +
 BaseTools/Source/C/BrotliCompress/dec/bit_reader.h |   383 +
 BaseTools/Source/C/BrotliCompress/dec/context.h    |   251 +
 BaseTools/Source/C/BrotliCompress/dec/decode.c     |  2347 ++++
 BaseTools/Source/C/BrotliCompress/dec/decode.h     |   188 +
 BaseTools/Source/C/BrotliCompress/dec/huffman.c    |   357 +
 BaseTools/Source/C/BrotliCompress/dec/huffman.h    |    68 +
 BaseTools/Source/C/BrotliCompress/dec/port.h       |   159 +
 BaseTools/Source/C/BrotliCompress/dec/prefix.h     |   751 ++
 BaseTools/Source/C/BrotliCompress/dec/state.c      |   168 +
 BaseTools/Source/C/BrotliCompress/dec/state.h      |   246 +
 BaseTools/Source/C/BrotliCompress/dec/transform.h  |   300 +
 .../docs/brotli-comparison-study-2015-09-22.pdf    |   Bin 0 -> 215208 bytes
 .../C/BrotliCompress/enc/backward_references.c     |   892 ++
 .../C/BrotliCompress/enc/backward_references.h     |    99 +
 .../C/BrotliCompress/enc/backward_references_inc.h |   147 +
 BaseTools/Source/C/BrotliCompress/enc/bit_cost.c   |    35 +
 BaseTools/Source/C/BrotliCompress/enc/bit_cost.h   |    63 +
 .../Source/C/BrotliCompress/enc/bit_cost_inc.h     |   127 +
 .../C/BrotliCompress/enc/block_encoder_inc.h       |    33 +
 .../Source/C/BrotliCompress/enc/block_splitter.c   |   197 +
 .../Source/C/BrotliCompress/enc/block_splitter.h   |    51 +
 .../C/BrotliCompress/enc/block_splitter_inc.h      |   432 +
 .../C/BrotliCompress/enc/brotli_bit_stream.c       |  1334 +++
 .../C/BrotliCompress/enc/brotli_bit_stream.h       |   107 +
 BaseTools/Source/C/BrotliCompress/enc/cluster.c    |    56 +
 BaseTools/Source/C/BrotliCompress/enc/cluster.h    |    48 +
 .../Source/C/BrotliCompress/enc/cluster_inc.h      |   315 +
 BaseTools/Source/C/BrotliCompress/enc/command.h    |   163 +
 .../C/BrotliCompress/enc/compress_fragment.c       |   747 ++
 .../C/BrotliCompress/enc/compress_fragment.h       |    58 +
 .../enc/compress_fragment_two_pass.c               |   557 +
 .../enc/compress_fragment_two_pass.h               |    51 +
 BaseTools/Source/C/BrotliCompress/enc/compressor.h |   161 +
 BaseTools/Source/C/BrotliCompress/enc/context.h    |   184 +
 .../Source/C/BrotliCompress/enc/dictionary_hash.h  |  4121 +++++++
 BaseTools/Source/C/BrotliCompress/enc/encode.c     |  1562 +++
 BaseTools/Source/C/BrotliCompress/enc/encode.h     |   221 +
 .../Source/C/BrotliCompress/enc/encode_parallel.h  |    27 +
 .../Source/C/BrotliCompress/enc/entropy_encode.c   |   501 +
 .../Source/C/BrotliCompress/enc/entropy_encode.h   |   122 +
 .../C/BrotliCompress/enc/entropy_encode_static.h   |   539 +
 BaseTools/Source/C/BrotliCompress/enc/fast_log.h   |   145 +
 .../C/BrotliCompress/enc/find_match_length.h       |    80 +
 BaseTools/Source/C/BrotliCompress/enc/hash.h       |   717 ++
 .../BrotliCompress/enc/hash_forgetful_chain_inc.h  |   249 +
 .../C/BrotliCompress/enc/hash_longest_match_inc.h  |   241 +
 .../enc/hash_longest_match_quickly_inc.h           |   230 +
 BaseTools/Source/C/BrotliCompress/enc/histogram.c  |    95 +
 BaseTools/Source/C/BrotliCompress/enc/histogram.h  |    60 +
 .../Source/C/BrotliCompress/enc/histogram_inc.h    |    51 +
 .../Source/C/BrotliCompress/enc/literal_cost.c     |   178 +
 .../Source/C/BrotliCompress/enc/literal_cost.h     |    30 +
 BaseTools/Source/C/BrotliCompress/enc/memory.c     |   181 +
 BaseTools/Source/C/BrotliCompress/enc/memory.h     |    62 +
 BaseTools/Source/C/BrotliCompress/enc/metablock.c  |   515 +
 BaseTools/Source/C/BrotliCompress/enc/metablock.h  |   110 +
 .../Source/C/BrotliCompress/enc/metablock_inc.h    |   183 +
 BaseTools/Source/C/BrotliCompress/enc/port.h       |   168 +
 BaseTools/Source/C/BrotliCompress/enc/prefix.h     |    52 +
 BaseTools/Source/C/BrotliCompress/enc/quality.h    |   130 +
 BaseTools/Source/C/BrotliCompress/enc/ringbuffer.h |   160 +
 .../Source/C/BrotliCompress/enc/static_dict.c      |   478 +
 .../Source/C/BrotliCompress/enc/static_dict.h      |    37 +
 .../Source/C/BrotliCompress/enc/static_dict_lut.h  | 11241 +++++++++++++++++++
 BaseTools/Source/C/BrotliCompress/enc/streams.h    |   121 +
 BaseTools/Source/C/BrotliCompress/enc/utf8_util.c  |    85 +
 BaseTools/Source/C/BrotliCompress/enc/utf8_util.h  |    32 +
 BaseTools/Source/C/BrotliCompress/enc/write_bits.h |    90 +
 BaseTools/Source/C/BrotliCompress/tools/bro.c      |   538 +
 BaseTools/Source/C/BrotliCompress/tools/version.h  |    14 +
 BaseTools/Source/C/GNUmakefile                     |     1 +
 BaseTools/Source/C/Makefile                        |     1 +
 .../BrotliCustomDecompressLib.inf                  |    56 +
 .../BrotliCustomDecompressLib/BrotliDecompress.c   |   321 +
 .../BrotliDecompressLib.uni                        |    21 +
 .../BrotliDecompressLibInternal.h                  |    71 +
 .../GuidedSectionExtraction.c                      |   196 +
 .../Library/BrotliCustomDecompressLib/LICENSE      |    19 +
 .../Library/BrotliCustomDecompressLib/README.md    |    26 +
 .../Library/BrotliCustomDecompressLib/ReadMe.txt   |     2 +
 .../BrotliCustomDecompressLib/common/constants.h   |    47 +
 .../BrotliCustomDecompressLib/common/dictionary.c  |  9474 ++++++++++++++++
 .../BrotliCustomDecompressLib/common/dictionary.h  |    29 +
 .../BrotliCustomDecompressLib/common/port.h        |   107 +
 .../BrotliCustomDecompressLib/common/types.h       |    72 +
 .../BrotliCustomDecompressLib/dec/bit_reader.c     |    48 +
 .../BrotliCustomDecompressLib/dec/bit_reader.h     |   384 +
 .../BrotliCustomDecompressLib/dec/context.h        |   251 +
 .../Library/BrotliCustomDecompressLib/dec/decode.c |  2348 ++++
 .../Library/BrotliCustomDecompressLib/dec/decode.h |   188 +
 .../BrotliCustomDecompressLib/dec/huffman.c        |   357 +
 .../BrotliCustomDecompressLib/dec/huffman.h        |    69 +
 .../Library/BrotliCustomDecompressLib/dec/port.h   |   159 +
 .../Library/BrotliCustomDecompressLib/dec/prefix.h |   751 ++
 .../Library/BrotliCustomDecompressLib/dec/state.c  |   169 +
 .../Library/BrotliCustomDecompressLib/dec/state.h  |   246 +
 .../BrotliCustomDecompressLib/dec/transform.h      |   300 +
 .../docs/brotli-comparison-study-2015-09-22.pdf    |   Bin 0 -> 215208 bytes
 MdeModulePkg/MdeModulePkg.dec                      |     3 +
 MdeModulePkg/MdeModulePkg.dsc                      |     1 +
 115 files changed, 60196 insertions(+)
 create mode 100644 BaseTools/BinWrappers/PosixLike/Brotli
 create mode 100644 BaseTools/BinWrappers/PosixLike/BrotliCompress
 create mode 100644 BaseTools/Source/C/BrotliCompress/BrotliCompress.bat
 create mode 100644 BaseTools/Source/C/BrotliCompress/GNUmakefile
 create mode 100644 BaseTools/Source/C/BrotliCompress/LICENSE
 create mode 100644 BaseTools/Source/C/BrotliCompress/Makefile
 create mode 100644 BaseTools/Source/C/BrotliCompress/README.md
 create mode 100644 BaseTools/Source/C/BrotliCompress/ReadMe.txt
 create mode 100644 BaseTools/Source/C/BrotliCompress/common/constants.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/common/dictionary.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/common/dictionary.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/common/port.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/common/types.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/bit_reader.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/bit_reader.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/context.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/decode.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/decode.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/huffman.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/huffman.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/port.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/prefix.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/state.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/state.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/dec/transform.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/docs/brotli-comparison-study-2015-09-22.pdf
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/backward_references.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/backward_references.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/backward_references_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/bit_cost.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/bit_cost.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/bit_cost_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/block_encoder_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/block_splitter.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/block_splitter.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/block_splitter_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/brotli_bit_stream.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/brotli_bit_stream.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/cluster.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/cluster.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/cluster_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/command.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/compress_fragment.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/compress_fragment.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/compress_fragment_two_pass.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/compress_fragment_two_pass.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/compressor.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/context.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/dictionary_hash.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/encode.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/encode.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/encode_parallel.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/entropy_encode.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/entropy_encode.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/entropy_encode_static.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/fast_log.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/find_match_length.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/hash.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/hash_forgetful_chain_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/hash_longest_match_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/hash_longest_match_quickly_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/histogram.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/histogram.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/histogram_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/literal_cost.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/literal_cost.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/memory.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/memory.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/metablock.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/metablock.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/metablock_inc.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/port.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/prefix.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/quality.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/ringbuffer.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/static_dict.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/static_dict.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/static_dict_lut.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/streams.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/utf8_util.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/utf8_util.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/enc/write_bits.h
 create mode 100644 BaseTools/Source/C/BrotliCompress/tools/bro.c
 create mode 100644 BaseTools/Source/C/BrotliCompress/tools/version.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/BrotliCustomDecompressLib.inf
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/BrotliDecompress.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/BrotliDecompressLib.uni
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/BrotliDecompressLibInternal.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/GuidedSectionExtraction.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/LICENSE
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/README.md
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/ReadMe.txt
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/common/constants.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/common/dictionary.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/common/dictionary.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/common/port.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/common/types.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/bit_reader.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/bit_reader.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/context.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/decode.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/decode.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/huffman.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/huffman.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/port.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/prefix.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/state.c
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/state.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/dec/transform.h
 create mode 100644 MdeModulePkg/Library/BrotliCustomDecompressLib/docs/brotli-comparison-study-2015-09-22.pdf

-- 
2.10.2.windows.1



^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2017-03-30  5:21 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2017-03-23  2:15 [PATCH 0/4] MdeModulePkg/BaseTools: Add Brotli algorithm support Song, BinX
2017-03-23  6:05 ` Song, BinX
2017-03-27  3:15   ` Gao, Liming
2017-03-29 21:04     ` Michael Zimmermann
2017-03-30  4:45       ` Gao, Liming
2017-03-30  5:13         ` Michael Zimmermann
2017-03-30  5:21           ` Gao, Liming

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox