100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
Best Local LLMs GitHub Repositories
Top 167 open source projects in Local LLMs. Ranked by stars, activity, and recorded community growth.
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
TradingAgents: Multi-Agents LLM Financial Trading Framework
A high-throughput and memory-efficient inference and serving engine for LLMs
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.
Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps