On Device AI GitHub Repositories (2026) · Open Source Tools

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

Local computer use on Apple silicon: on-device typed decisions with laya and form filling with CUA-S1-FORMS, driven through the macOS Accessibility API

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

A browser extension for easy on-device translation with a local LLM (PLaMo). Private, free, no server needed.

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.

A photo gallery for Android with the smart features of Google Photos and iPhone Photos. Nothing leaves your phone.

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.

DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook

Open-source iOS app connecting Meta Ray-Ban smart glasses to AI — 5 backends (on-device MLX models, Apple Intelligence, OpenAI, Gemini Live, OpenClaw), on-device neural voice, face recognition & live web search. Private and offline-capable.

Records and transcribes online meetings. Automatically

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.

Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.

Cross-platform on-device AI toolkit

Free, on-device AI dictation and meeting notes for macOS. Sub-second dictation with Parakeet and Whisper on Apple Silicon, plus optional AI polish. EnviousMeet (Beta): record calls with no bot, get who-said-what transcripts and AI summaries on your Mac. No account, no subscription, open source. Your audio never leaves your Mac.

Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.