Gpu GitHub Repositories (2026) · Open Source Tools

RapidFire AI: Rapid AI Customization from RAG to Fine-Tuning

Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.

Self-hosted functional language with explicit effects. Compiles to JVM bytecode, C, and NVIDIA GPU kernels via cuTile.

Run your AI agents on machines you already own, as one private P2P mesh. OpenAI-compatible, sandboxed with Podman, signed reputation, no cloud.

Data Parallel Extension for NumPy

GPU-capable global atmosphere model of the CliMA Earth System Model, designed for calibration with data assimilation and machine learning

Python SYCL bindings and SYCL-based Python Array API library

Adaptive local inference for Hermes — TurboFit Check, evidence-built TurboFit List, repaired discovery/benchmark campaigns, Qwen 3.8 DFlash2, Bonsai DSpark, FreeToken, and Sirvir.

Pure Go FFI for WebGPU - CGO-free GPU access via wgpu-native bindings

Glass globes of water, simulated live on the GPU with WebGPU and three.js

Your servers' BMCs as Kubernetes resources: zero-config in-band discovery, hardware health, Prometheus metrics, a slick dashboard and out-of-band power control. IPMI & Redfish.

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.

Serve your models fast on your own infra in 3 steps.

A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or Flash-Next (125B-A6B MoE) on an A100-80G. The cost is shown before it starts; chat with images; Codex or any OpenAI client uses a fixed local /v1. Auto-stop, CU ledger, live prefill/decode. Windows, macOS, Linux.

Cross-platform GPU rendering, composition, vector, text, compute, and DirectX/LibreWPF/WinUI/Avalonia interop on WebGPU and Silk.NET.

Comprehensive, GPU accelerated framework for developing universal virtual quantum processors

Performance-portable geometric search library

🐍 | Python library for Runpod API and serverless worker SDK.

A full-stack framework for quantum computing.

Embeddable physically based renderer