Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
↑ +26 today
Discover the best On Device LLM open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.