Llama Cpp GitHub Repositories (2026) · Open Source Tools

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by Gemma 4 . 100% local, 100% private.

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more

ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses.

Free local-first AI business advisor with evidence-linked research and verifiable pilot plans.

Adaptive local inference for Hermes — TurboFit Check, evidence-built TurboFit List, repaired discovery/benchmark campaigns, Qwen 3.8 DFlash2, Bonsai DSpark, FreeToken, and Sirvir.

Run your AI models at home in one binary: chat, persistent memory, web access, browser control, MCP tools, encryption at rest and end-to-end encrypted remote access. Linux, macOS, Windows. FR/EN docs.

Your personal context engine for macOS, with Windows and Linux in alpha: on-device meeting notes, screen recall, dictation, and autocomplete that you and your AI agents can search. Free and open source (GPLv3).

Private AI summarizer for anything you read. Inspired by Mozilla's Orbit.

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

Turn an old Android phone into a home server: SSH, web hosting, Jellyfin with hardware transcoding, Immich, qBittorrent, Home Assistant and a web dashboard. No root.

GamePause for Local AI: a Windows tray app that pauses LM Studio, Ollama and other local AI servers while you game, and restores them afterward.

Local, open-source voice dictation that types what you meant: Parakeet/Whisper + a LoRA-tuned Qwen cleanup model, in Rust. 100% on-device.

One serving daemon for local LLM inference — across runtimes and machines.

Offline AI research assistant for Android. Answers from Wikipedia and other reference packs on the phone, with citations. Gemma 4 runs on the Pixel 10's Tensor NPU (first word in about 2 s); other phones use llama.cpp. No INTERNET permission.

A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.