CUDA GitHub Repositories (2026) · Open Source Tools

Turn dials. Summon bangers! NOW WITH MORE C++! Local AI music generation powered by GGML

Ultrafast serverless GPU inference, sandboxes, and background jobs

High-performance multi-platform compiler for physics simulation

Programmable CUDA/C++ GPU Graph Analytics

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

C++ library for solving large sparse linear systems with algebraic multigrid method

gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain Finite-Difference (FDTD) code for numerical modelling of Ground Penetrating Radar (GPR), antennas, radar and bioelectromagnetics

An app and guide to easily configure Windows, Linux, MacOS, Google TV, Stremio, Home Assistant and more (including WSL2, GPU drivers & development tools). Improve your UX & productivity.

Numerical linear algebra software package

DaCe - Data Centric Parallel Programming

A C++-based, cross platform ray tracing library

NVIDIA RMM is a library for allocating and managing GPU memory in C++ and Python.

A blazing-fast, memory-safe neural network library for Rust that brings the power of FANN to the modern world.

LargeScale Multiphysics Scientific Simulation Environment-OneFLOW CFD

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

A flyweight in situ visualization and analysis runtime for multi-physics HPC simulations

ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.

High-performance Ultralytics YOLO inference in Rust with ONNX Runtime, GPU backends, CLI, and WebGPU/WASM.

Self-hosted functional language with explicit effects. Compiles to JVM bytecode, C, and NVIDIA GPU kernels via cuTile.

Kindi 0.4: local LLM inference on low-cost NVIDIA GPUs, Radeon 780M and CPUs. Bonsai 2B-27B, AH-Nanbeige4.3-33B and experimental Nemotron, with an OpenAI-compatible server.