Local AI GitHub Repositories (2026) · Open Source Tools

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Curated list of self-hosted open-source AI: local LLMs, chat UIs, agents, MCP servers, RAG, speech and image generation. Health-checked weekly, dead projects removed automatically.

Turn dials. Summon bangers! NOW WITH MORE C++! Local AI music generation powered by GGML

Private AI meeting notes. Free and open source.

Phosphene is a free, open-source Mac app for making AI videos, pictures, speech and songs offline. Run LTX-2.5 and MiniMax H3 (Hailuo) locally on Apple Silicon: text-to-video and image-to-video with sound, lip-sync, character LoRA training. Mac app or Pinokio. No cloud, no API key, no NVIDIA GPU. Works with Claude Code, Codex and any MCP agent.

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Create high-fidelity Codex companions from 2+ photos with local open-weight neural editing and no OpenAI API key.

Edit photos by describing the change, on your own GPU. A free, open-source alternative to Nano Banana and ChatGPT image editing: photos stay on your computer, no daily limit. One installer for Windows, Mac and Linux sets up the best open model (Qwen-Image 2.1). MCP server for AI agents.

The free open source offline writing assistant assist with grammar, rewriting & tone entirely on your machine.

A lightweight Gradio WebUI for stable-diffusion.cpp.

A Python framework for modular, self-contained skill management for machines.

Free local-first Windows companion for job search and everyday work, with editable responses.

Your private, on-device personal AI assistant for macOS and Windows. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval. No cloud or account.

Generative Fill, Remove object, Generative Expand and Text to Image for PhotoCraft and GIMP 3. Free, local, on your own GPU through ComfyUI.

Free local-first AI business advisor with evidence-linked research and verifiable pilot plans.

Thai + English voice typing for Mac. Offline speech-to-text that types Thai-spoken tech words in English. Push-to-talk dictation on Apple Silicon (Whisper + MLX), free & open-source Wispr Flow alternative · พิมพ์ด้วยเสียงภาษาไทย

Run your AI models at home in one binary: chat, persistent memory, web access, browser control, MCP tools, encryption at rest and end-to-end encrypted remote access. Linux, macOS, Windows. FR/EN docs.

Open-Source Intelligent Command Layer

Free, open-source AI film studio on your own PC. Recurring characters, MiniMax H3 and Seedance shots, voices, music, a short-film wizard and a real editor, on your ComfyUI or your own cloud GPU. Windows, Mac and Linux, with 214 MCP tools so Claude Code, Codex or Hermes can run it.