Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Home / Topics / LLM
Topic Catalog

LLM GitHub Repositories (2026) · Open Source Tools

Discover the best LLM open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.

SPONSORED BY
948 matching projects · updated Nov 21, 2026 How we rank ↗
defilantech
#261 TRENDING defilantech/LLMKube Go NEW 2025

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

46 ↑ +35 today
deepset-ai
#262 TRENDING deepset-ai/haystack Python 2019

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

3.4K ↑ +15 today
simplexai-labs
#263 TRENDING simplexai-labs/PolyStrata C++ NEW 2026

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

117 ↑ +15 today
SPONSORED Featured Developer Tools & Services
From our network
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.

SPONSORED Sponsored Partner