Compression GitHub Repositories (2026) · Open Source Tools

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

Brotli compression library for Go (RFC 7932), pure Go, no cgo, encoder + decoder, highly optimized

State-of-the-art LLM compression, built for production inference with vLLM

Context intelligence layer for LLM agents: persistent memory with write-time dedup, sensitivity tagging, conflict detection, and hierarchical decay. ~12ms. No LLM calls. MIT.

Neural Network Compression Framework for enhanced OpenVINO™ inference

Dinky makes files smaller.

Aphrodite 💋 CCR compression proxy + absorptive preview pipeline for Hermes Agent - headroom-core engine, type-aware classifier, tool relay, ~10 ms end-to-end.

Fast, memory-safe Rust zstd codec with all-level decode, -7..4 encode, and dictionary training.

Archive manager and 7zip replacement for macOS. Preview (nested) archives without extracting them. Extract single files.

A self-extracting archiving tool for Unix systems, in 100% shell script.

A blazingly fast multi-language serialization framework for idiomatic domain objects, schema IDL, and cross-language data exchange.

CSS & JavaScript minifier, in PHP. Removes whitespace, strips comments, combines files (incl. @import statements and small assets in CSS files), and optimizes/shortens a few common programming patterns.

Bichon – A lightweight, high-performance Rust email archiver with WebUI

Assembled Genomes Compressor (AGC) squeezing 290 GB of Human Pangenome Project assemblies down to <1.5 GB (>190× ratio), with sample and contig extraction in seconds.

File format for 3D Gaussian splats. About 10x smaller than the PLY equivalent with virtually no perceptible loss in visual quality. Offered as open source by Niantic Labs. More details at https://scaniverse.com/spz #3dgaussiansplats #gaussiansplatting

Lightning fast, ad free, super lightweight native video compressor for Android

A rust binding for the zstd compression library.