Distributed Computing GitHub Repositories (2026) · Open Source Tools

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

Library for bringing distributed capabilities to Apache DataFusion

Distributed Stockfish analysis for lichess.org

Connect threads, processes, hosts, and languages without a broker.

A toolkit to run Ray applications on Kubernetes

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, Gaudi NPU, Google TPU, GraphCore IPU and other NPUs.

Open-source software for volunteer computing and grid computing.

Making large AI models cheaper, faster and more accessible

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Ultrafast serverless GPU inference, sandboxes, and background jobs

User-friendly Scheduler for sub-node tasks for HPC systems

Modern C++ actor framework based on std::execution, only requires C++20 - Turns your class into async service.

AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Run your AI agents on machines you already own, as one private P2P mesh. OpenAI-compatible, sandboxed with Podman, signed reputation, no cloud.

A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.