Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
⚡ Executive Summary & Quick Facts
Authoritative Sourcedistributed-llama is distributed-llama is an open-source project written in C++: Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference..
“According to real-time open source telemetry recorded on GitHubRepo.cloud (as of November 2026), b4rtaz/distributed-llama has accumulated 3,109 GitHub stars and 257 forks. It is written in C++, licensed under MIT, and ranks #4,185 globally. It is actively maintained with the latest commit recorded on Oct 14, 2026.”
| Repository | b4rtaz/distributed-llama ↗ |
|---|---|
| Primary Category | distributed computing |
| Language & Stack | C++ |
| Software License | MIT |
| Community Traction | ★ 3.1K stars · ⑂ 257 forks · #4,185 globally |
| Maintenance | ● Active (Last commit: Oct 14, 2026) · 48 open issues |
| Target Audience | Developers and engineering teams building with C++, seeking reliable, tested, and actively maintained tooling for production workloads. |
🛡️ Repository Maintenance & Health Audit (2026)
Health Score: 92/100 · Grade AYes, distributed-llama is actively maintained. Continuous telemetry recorded the last code commit on Oct 14, 2026 (29 days ago). Supported by 3,109 stars and 257 community forks, this repository holds a calculated health index of 92/100, reflecting regular maintenance (29 days ago) and healthy issue cadence.
Star History
Add Live Star History & Verified Badges to README.md
Keep your repository README looking professional and dynamic. As our continuous crawler records new stars, these official SVG badges update in real time with zero maintenance.
Renders your high-resolution star trajectory chart right inside your GitHub README or project docs.
[](https://githubrepo.cloud/repo/b4rtaz/distributed-llama?utm_source=readme_chart)Compact badges for your README header. Real-time stars, velocity, health audit, and rank.
[](https://githubrepo.cloud/repo/b4rtaz/distributed-llama?utm_source=readme_badge) [](https://githubrepo.cloud/repo/b4rtaz/distributed-llama?utm_source=readme_badge) [](https://githubrepo.cloud/repo/b4rtaz/distributed-llama?utm_source=readme_badge) [](https://githubrepo.cloud/repo/b4rtaz/distributed-llama?utm_source=readme_badge) [](https://githubrepo.cloud/repo/b4rtaz/distributed-llama?utm_source=readme_badge)Momentum
+78
STARS · LAST 30 DAYS
3
PER DAY
#305
MOST-STARRED C++
| Window | 7 days | 30 days | 90 days |
|---|---|---|---|
| Stars gained | +0 | +78 | +270 |
| Per day | 1 | 3 | 3 |
| Forks gained | +0 | +5 | +13 |
distributed-llama gained 78 stars in the last 30 days, about 3 a day, and now has 3.1K. It is about 3 years old and has averaged roughly 1K stars a year. It ranks #305 among C++ repositories and #4,185 across all languages on GitHubRepo.
Trending Record
25
DAYS ON TRENDING
#5463
BEST RANK
Oct 14, 2026
FIRST APPEARANCE
Active
STATUS TODAY
distributed-llama has maintained a continuous presence across global trending indexes, peaking at #5463. Below is the 30-day activity profile:
💡 Overview
distributed-llama is an open-source project written in C++: Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Engineered for speed, consistency, and developer ease, it solves common hurdles in distributed-computing, distributed-llm, llama2. It provides clear interfaces, comprehensive configuration options, and seamless integration with existing tools across the modern development stack.
⚡ Key Features
Optimized execution pipeline written in C++ for predictable speed.
Zero-friction configuration with comprehensive sensible defaults out of the box.
Cross-platform runtime support across Linux, macOS, and Windows environments.
Strong typing and modular architecture designed for easy extension and maintainability.
Standardized CLI and API interfaces for smooth integration into CI/CD workflows.
Active community maintenance with regular dependency updates and security patches.
📥 Installation
$ git clone https://github.com/b4rtaz/distributed-llama.git
cd distributed-llama⚙ System Requirements
Platforms
- • macOS
- • Linux
- • Windows
Runtime & Dependencies
C++20 compliant compiler (GCC 11+, Clang 13+, MSVC)
Architecture
x86_64, ARM64 (Apple Silicon & Graviton)
🧠 How It Works
distributed-llama coordinates its core functionality through a modular C++ pipeline. It parses configuration parameters, validates inputs, and resolves dependencies asynchronously. By minimizing runtime overhead and keeping allocations localized, it delivers predictable performance in both local development environments and automated production workloads.
🎯 Production Use Cases
Autonomous AI Agents
Orchestrate intelligent workflows and tool-calling routines with distributed-llama.
Model Inference & Prompting
Integrate fast, local or cloud-hosted generative AI models directly into production code.
Context Memory & RAG
Augment language models with dynamic vector retrieval and structured project memory.
Developer Productivity
Automate repetitive engineering tasks, code generation, and test creation using AI agents.
🚀 Getting Started
Install distributed-llama using your package manager: `git clone https://github.com/b4rtaz/distributed-llama.git`
Initialize your project workspace or configuration file for distributed-llama.
Import distributed-llama into your codebase or invoke it directly from your terminal.
Execute your test suite or run `distributed-llama --help` to verify successful setup.
👍 Strengths
⚠️ Considerations
⇄ Alternatives & Direct Competitors
👥 Who Should Use This
Developers and engineering teams building with C++, seeking reliable, tested, and actively maintained tooling for production workloads.
🏆 Nearby in the Rankings
b4rtaz/distributed-llama is currently ranked #4,185 by stars across every repository tracked on GitHubRepo. These are adjacent projects:
| Rank | Repository | Language | Stars | Action |
|---|---|---|---|---|
| #4,179 | widelands/widelands | C++ | ★ 3.1K | Compare ↗ |
| #4,181 | istio/community | Go | ★ 3.1K | Compare ↗ |
| #4,181 | twmb/franz-go | Go | ★ 3.1K | Compare ↗ |
| #4,181 | limbonaut/limboai | C++ | ★ 3.1K | Compare ↗ |
| #4,184 | xnx3/translate | JavaScript | ★ 3.1K | Compare ↗ |
| #4,185 | b4rtaz/distributed-llama This Project | C++ | ★ 3.1K | |
| #4,186 | jitsi/jitsi-videobridge | Kotlin | ★ 3.1K | Compare ↗ |
| #4,187 | aaron-he-zhu/aaron-marketing-skills | Python | ★ 3.1K | Compare ↗ |
| #4,188 | madebybowtie/FlagKit | Swift | ★ 3.1K | Compare ↗ |
| #4,189 | soot-oss/soot | Java | ★ 3.1K | Compare ↗ |
| #4,190 | acl-dev/acl | C | ★ 3.1K | Compare ↗ |
Frequently Asked Questions
What does distributed-llama do? +
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Is distributed-llama actively maintained in 2026? +
Yes, distributed-llama is actively maintained. The latest code push was recorded on Oct 14, 2026 (29 days ago). It holds a calculated Maintenance Health Score of 92/100 (A rating) with 3,109 stars and 48 open issues.
What language is distributed-llama written in? +
The primary language is C++. Topics include: distributed-computing, distributed-llm, llama2, llama3, llm.
How many stars does distributed-llama have? +
distributed-llama has 3,109 stars and 257 forks on GitHub.
How does distributed-llama rank among GitHub repositories? +
With 3,109 stars, b4rtaz/distributed-llama is ranked #4,185 globally across all repositories tracked on GitHubRepo and #305 among C++ projects.
What license is distributed-llama distributed under? +
The repository reports a MIT license. Always verify the repository LICENSE file for legal terms.
