State of the art inference performance with modern accelerators on Kubernetes
↑ +77 today
llm-d
3 tracked repositories
☆ 5.7K TOTAL STARS
⑂ 1.6K TOTAL FORKS
↗ +68 STARS TODAY
★ Add Profile Badge to your GitHub README.md
Auto-UpdatingShowcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/llm-d)Repositories
Sorted by stars
llm-d Router: The intelligent entry point for inference requests
↑ +9 today
A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
↑ +1 today
From our network