Discover the best On Device AI open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Local-first AI photo culling for professional photographers — 6-axis rubric, XMP/IPTC export, Lightroom & Capture One ready.
An experimental local AI runtime. It relays one request through five small models with one job each, on a single 8 GB consumer GPU.
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels integration, and runnable examples with documented OS, SDK and model requirements.
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift
Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow + Littlebird alternative)
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
Your private, on-device personal AI assistant for macOS and Windows. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval. No cloud or account.
Thai + English voice typing for Mac. Offline speech-to-text that types Thai-spoken tech words in English. Push-to-talk dictation on Apple Silicon (Whisper + MLX), free & open-source Wispr Flow alternative · พิมพ์ด้วยเสียงภาษาไทย
RikkaHub Agent · Pure — an Android AI agent that survives long runs. Independent hardening pass on the rikkahub on-device agent: usage ledger & budgets, on-demand tools, expert sub-agents, cold memory, chained workflows. Kotlin/Compose, Shizuku/Termux/MCP. QQ group 1030362371.
On-device transcripts and summaries of your recorded phone calls. Made for GrapheneOS; nothing leaves the phone.
Offline AI narration studio for Android: turn scripts into natural speech and clone your voice, all on-device. No cloud, no account.
Commit messages written on your Mac by Apple Intelligence. Your code never leaves the machine.