SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
↑ +1 today
huawei-csl
1 tracked repository
☆ 187 TOTAL STARS
⑂ 8 TOTAL FORKS
↗ +1 STARS TODAY
★ Add Profile Badge to your GitHub README.md
Auto-UpdatingShowcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/huawei-csl)Repositories
Sorted by stars
From our network