English»Software»Data Structures & Algorithms»Compression | searchivarius.org
log in | about 

snappy - A fast compressor/decompressor - Google Project Hosting   - A lightweight compression from Google. It offers very high compression/decompression speeds at the expense of lower compression rates.
64-bit Integer Coders  Vo Ngoc Anh , Alistair Moffat
A collection of succinct data structures  Giuseppe Ottaviano
Alenka   - GPU database engine with ultrafast GPU compression.
Blosc   - A blocking, shuffling and loss-less compression library that can be faster than `memcpy()`
brotli   - Google's brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression.
C Minimal Perfect Hashing Library  Davi de Castro Reis, Djamal Belazzougui, Fabiano Cupertino Botelho
C/C++ library for fast compression and intersection of lists of sorted integers using SIMD instructions.  
Compression-based learning  
DYNAMIC  Nicola Prezza - a succinct and compressed dynamic data structures library.
FastPFor: Fast integer compression  Daniel Lemire, Leonid Boytsov, Owen Kaser, Maxime Caron, Louis Dionne - A research library with integer compression schemes. It should be suitable for applications to d-gap compression and delta coding in general. It relies on SIMD instructions and is, therefore, very fast.
FM-Index  Matthias Petri
Giddy   - lightweight GPU decompression library.
GPU-Accelerated Faster Decoding of Integer Lists  Antonio Mallia
Integer Encoding Library   - Light-weight integer compression/decompression.
Large Text Compression Benchmark  Matt Mahoney
Lepton   - a tool and file format for losslessly compressing JPEGs by an average of 22% (invented by Dropbox).
Lossy&fast float compression (from Tensorflow)  
PIGZ   - a parallel implementation of gzip for modern multi-processor, multi-core machines.
Pik   - a new lossy image format for the internet.
Pizza&Chili Corpus  Gonzalo Navarro, Paolo Ferragina
Succinct Data Structure Library 2.0 (SDSL)  Simon Gog
Succinct Spark   - queries on Compressed relational databases (RDDs)
Sux: Implementing Succinct Data Structures  
Tongrams   - This library can be used to map N-grams to their corresponding (integer) frequency counts or to (floating point) probabilities and backoffs for backoff-interpolated Knenser-Ney models.
WebGraph   - a framework for graph compression
Zstandard (zstd)   - Fast real-time compression algorithm.