CUDA GitHub Repositories (2026) · Open Source Tools

Publication quality path tracing in real time.

Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.

A lightweight Transformer training & inference framework

A model-agnostic GPU runtime for shipping models as verified programs.

Run your AI models at home in one binary: chat, persistent memory, web access, browser control, MCP tools, encryption at rest and end-to-end encrypted remote access. Linux, macOS, Windows. FR/EN docs.

PSSA: a non-transformer language model written from scratch in Rust. Recurrent state-space layer, episodic memory, self-modifying weights, CUDA training, and a full terminal dashboard.

Fast, concurrent inference for YuE2. Same model and recipe: 1.68× faster per song, 3.31× more songs per GPU.

Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.

JEV-inspired parallel decisions for CUDA LLMs. One context, many decisions. vLLM API, game-agent examples, and reproducible benchmarks.

Identify anime characters and series in images

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.

Laplace's Scissors: protected readout rotations for open LLMs. Diagnose weak output directions, repair answers, preserve successful generations, and analyze scaling deviations with Rust and Triton on CUDA/HIP.

Calibration software for the Murchison Widefield Array (MWA) radio telescope

Comprehensive, GPU accelerated framework for developing universal virtual quantum processors

Performance-portable geometric search library

Train and serve LLMs at extreme speed and massive throughput.

LuxCore source repository

An efficient C++20 GPU numerical computing library with Python-like syntax

🤖 A Python library for learning and evaluating knowledge graph embeddings

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes