Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Home / Topics / Local Inference
Topic Catalog

Local Inference GitHub Repositories (2026) · Open Source Tools

Discover the best Local Inference open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.

SPONSORED BY
3 matching projects · updated Nov 21, 2026 How we rank ↗
ardanlabs
#2 TRENDING ardanlabs/kronk Go NEW 2025

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

61 ↑ +2 today
From our network
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.

SPONSORED Sponsored Partner