Top DISTRIBUTED-COMPUTING GitHub Repositories & Tools (2026)

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Ultrafast serverless GPU inference, sandboxes, and background jobs

A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, Gaudi NPU, Google TPU, GraphCore IPU and other NPUs.

Library for bringing distributed capabilities to Apache DataFusion