High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.
↑ +1 today
novitalabs
1 tracked repository
☆ 211 TOTAL STARS
⑂ 28 TOTAL FORKS
↗ +3 STARS TODAY
★ Add Profile Badge to your GitHub README.md
Auto-UpdatingShowcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/novitalabs)Repositories
Sorted by stars
From our network