Ggml GitHub Repositories (2026) · Open Source Tools

Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.

NeMo-Speech.cpp is a lightweight C++ inference runtime for Speech models

LLM inference in C/C++

ggml speech-to-text inference for 16+ model families

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx

Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read Turkish text. Patched audio.cpp, local UI, 7 synthetic voices.

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Turn dials. Summon bangers! NOW WITH MORE C++! Local AI music generation powered by GGML

Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more

CLI/GUI tool for efficient and easy safetensors and gguf model conversion

Offline AI narration studio for Android: turn scripts into natural speech and clone your voice, all on-device. No cloud, no account.

Running any GGUF SLMs/LLMs locally, on-device in Android