A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
↑ +1 today
3 tracked repositories
Showcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/kvcache-ai)
Sorted by stars
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
AgentENV (AENV) is a distributed platform for running agent environments at scale.