What are the best Inference API repositories on GitHub?

The top-ranked Inference API open source repositories include inference-gateway/inference-gateway, basetenlabs/truss, tracked and evaluated by community adoption, stars, and code commits.

How do I find trending Inference API open source tools?

Browse this curated Inference API directory to monitor real-time GitHub star velocity, latest code releases, and rising developer tools updated daily.

Are Inference API GitHub repositories free and open source?

Most Inference API projects listed here are distributed under open source licenses (such as MIT, Apache 2.0, or GPL). Always check individual project repositories for exact license terms.

Home / Topics / Inference API

Topic Catalog

Inference API GitHub Repositories (2026) · Open Source Tools

Discover the best Inference API open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.

SPONSORED BY

Kishan Kanani

Design & product building

Interviewly

Job search tools for developers

+ Advertise here

Your product in front of developers

+ Promote project

Get a video reel for your repo

2 matching projects · updated Oct 6, 2026 How we rank ↗

#1 TRENDING inference-gateway/inference-gateway Go NEW 2025

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

◇ agnostic ◇ anthropic ◇ api ◇ deepseek-v4-pro

50 ↑ +1 today

212

#2 TRENDING basetenlabs/truss Python 2022

The simplest way to serve AI/ML models in production

◇ artificial-intelligence ◇ easy-to-use ◇ falcon ◇ inference-api

130 ↑ +1 today

1.2K

From our network

Inference API GitHub Repositories (2026) · Open Source Tools

Built something? Put it in front of millions of developers.