Discover the best CUDA open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
Runs openpilot's large driving model on Jetson Orin Nano, macOS, iOS, Android, CUDA laptops with only your Comma, and a USB3 cable
Write Java. Run on GPUs. Fast.
NumPy aware dynamic Python compiler using LLVM
High-performance GPU-accelerated signal processing and visualization framework that runs anywhere.
UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms
Open-source RAW photo processing and digital asset management software.
CUDA compiler and runtime for Apple Silicon
NVIDIA cuML: GPU-Accelerated Machine Learning
LLM speculative inference server for heterogeneous hardware & consumer GPUs
A retargetable MLIR-based machine learning compiler and runtime toolkit.
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
Persist and reuse KV Cache to speedup your LLM.
High-Performance Rendering Framework on Stream Architectures
A Python framework for GPU-accelerated simulation, robotics, and machine learning.
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Molecular dynamics and Monte Carlo soft matter simulation on GPUs.