#1 TRENDING pegainfer-project/pegainfer Rust NEW 2026 Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2 ◇ cuda◇ cuda-kernels◇ deepseek◇ gpu 110 ↑ +1 today 712
#2 TRENDING feichai0017/orbitkv Rust NEW 2025 High Performance KV Cache for LLM Inference ◇ attention◇ kv-cache◇ llm-inference◇ memory-management 18 ↑ +1 today 279