a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
↑ +4 today
3 tracked repositories
Showcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/localai-org)
Sorted by stars
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
Track live or prerecorded humanoid movements to produce a 3D skeleton. C++/GGML conversion of NVIDIA's GEM-X
Track and extract any 3D object from video. C++/GGML convertion of Meta's sam3d PyTorch model plus a demo app