Distributed Training GitHub Repositories (2026) · Open Source Tools

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

Find why PyTorch training is slow, compare runs, and catch performance regressions in CI.

Best practices, reference architectures, and examples for distributed AI training and inference on AWS.

A SuperPod-Affinity Training Acceleration Framework.