Ascend GitHub Repositories (2026) · Open Source Tools

Persist and reuse KV Cache to speedup your LLM.

Heterogeneous GPU Sharing on Kubernetes

SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.