A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
↑ +3 today
Discover the best Incubating open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.