#1 TRENDING kvcache-ai/Mooncake C++ 2024 Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. ◇ disaggregation◇ inference◇ kvcache◇ llm 1.3K ↑ +18 today 6.7K
#2 TRENDING ome-projects/ome Go NEW 2025 Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton ◇ deepseek◇ k8s◇ kimi-k2◇ llama 98 ↑ +1 today 513