Big Data GitHub Repositories (2026) · Open Source Tools

ParquetSharp is a .NET library for reading and writing Apache Parquet files.

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)

Extensible SQL Lexer and Parser for Rust

Apache Calcite

Apache Beam is a unified programming model for Batch and Streaming data processing.

Apache Flink

Apache Drill is a distributed MPP query layer for self describing data

The Open Source Feature Store for AI/ML

Apache Ignite

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

Collaborative Datacenter Simulation and Exploration for Everybody

Open-Source Web UI for managing Apache Kafka clusters

YTsaurus is a scalable and fault-tolerant open-source big data platform.

Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.

Mirror of Apache Kudu

Distributed Big Data Orchestration Service

Apache TsFile

Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application