Compress GitHub Repositories (2026) · Open Source Tools

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Archive manager and 7zip replacement for macOS. Preview (nested) archives without extracting them. Extract single files.

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

Desktop app to download audio/video from hundreds of sites

Menu Bar App on MacOS and Windows that cuts Claude Code and Codex token costs by ~50%

Lossless AI compression: 33% less GPU memory, bit for bit.

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

An implementation of chunked, compressed, N-dimensional arrays for Python.

JavaScript library to zip and unzip files supporting parallel compression, web streams, pluggable compression engines, zip64, split files, data encryption, and deflate64 decompression.

A self-extracting archiving tool for Unix systems, in 100% shell script.

Neural Network Compression Framework for enhanced OpenVINO™ inference

Compressed Log Processor (CLP) is a free log management tool capable of compressing logs and searching the compressed logs without decompression.

The FastPFOR C++ library: Fast integer compression

Measure token savings per AI coding agent, optimize context, and share a live local knowledge graph across 16 CLI clients.

Persistent memory for LLMs and apps. Content-addressed storage with dedupe, compression, full-text and vector search.

Laravel SmartCache - Optimize Caching for Large Data

Assembled Genomes Compressor (AGC) squeezing 290 GB of Human Pangenome Project assemblies down to <1.5 GB (>190× ratio), with sample and contig extraction in seconds.

Context intelligence layer for LLM agents: persistent memory with write-time dedup, sensitivity tagging, conflict detection, and hierarchical decay. ~12ms. No LLM calls. MIT.

Rust libraries and programs focused on succinct data structures

Highly effective, super-configurable, well-tested web page minifier (enhanced successor to HTML Minifier)