| snappy - A fast compressor/decompressor - Google Project Hosting - A lightweight compression from Google. It offers very high compression/decompression speeds at the expense of lower compression rates.
|
| 64-bit Integer Coders Vo Ngoc Anh , Alistair Moffat |
| A collection of succinct data structures Giuseppe Ottaviano |
| Alenka - GPU database engine with ultrafast GPU compression.
|
| Blosc - A blocking, shuffling and loss-less compression library that can be faster than `memcpy()`
|
| brotli - Google's brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression.
|
| C Minimal Perfect Hashing Library Davi de Castro Reis, Djamal Belazzougui, Fabiano Cupertino Botelho |
| C/C++ library for fast compression and intersection of lists of sorted integers using SIMD instructions. |
| Compression-based learning |
| DYNAMIC Nicola Prezza - a succinct and compressed dynamic data structures library.
|
| FastPFor: Fast integer compression Daniel Lemire, Leonid Boytsov, Owen Kaser, Maxime Caron, Louis Dionne - A research library with integer compression schemes. It should be suitable for applications to d-gap compression and delta coding in general. It relies on SIMD instructions and is, therefore, very fast.
|
| FM-Index Matthias Petri |
| Giddy - lightweight GPU decompression library.
|
| GPU-Accelerated Faster Decoding of Integer Lists Antonio Mallia |
| Integer Encoding Library - Light-weight integer compression/decompression.
|
| Large Text Compression Benchmark Matt Mahoney |
| Lepton - a tool and file format for losslessly compressing JPEGs by an average of 22% (invented by Dropbox).
|
| Lossy&fast float compression (from Tensorflow) |
| PIGZ - a parallel implementation of gzip for modern multi-processor, multi-core machines.
|
| Pik - a new lossy image format for the internet.
|
| Pizza&Chili Corpus Gonzalo Navarro, Paolo Ferragina |
| Succinct Data Structure Library 2.0 (SDSL) Simon Gog |
| Succinct Spark - queries on Compressed relational databases (RDDs)
|
| Sux: Implementing Succinct Data Structures |
| Tongrams - This library can be used to map N-grams to their corresponding (integer) frequency counts or to (floating point) probabilities and backoffs for backoff-interpolated Knenser-Ney models.
|
| WebGraph - a framework for graph compression
|
| Zstandard (zstd) - Fast real-time compression algorithm.
|
