Bigdata GitHub Repositories (2026) · Open Source Tools

RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.

A Cloud Native Batch System (Project under CNCF)

The open source knowledgehouse for your company. Marmot knows what your data means, governs who may use it and runs every query your people and agents make, checked and recorded. Catalog, lineage, governed SQL and an MCP server in one Go binary.

Upserts, Deletes And Incremental Processing on Big Data.

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Apache Avro is a data serialization system.

World's First OSS Flink Accelerator built on Apache DataFusion

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

DataWave is an ingest/query framework that leverages Apache Accumulo to provide fast, secure data access.

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

Data management for the sensor-edge-cloud continuum

A data integration framework

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Distributed Big Data Orchestration Service

ROOT I/O in pure Python and NumPy.

Asynchronous HBase client for NodeJs using REST

Open Source Cloud Native Ingestion engine

A pure Java HDF5 library

A general purpose Distributed Systems Framework