Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
↑ +183 today
Discover the best Kvcache open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Persist and reuse KV Cache to speedup your LLM.
Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.