Generative AI extensions for onnxruntime
Star History
Momentum
+28
STARS · LAST 30 DAYS
1
PER DAY
#184
MOST-STARRED C++
| Window | 7 days | 30 days | 90 days |
|---|---|---|---|
| Stars gained | +7 | +28 | +90 |
| Per day | 1 | 1 | 1 |
| Forks gained | +2 | +7 | +18 |
onnxruntime-genai gained 28 stars in the last 30 days, about 1 a day, and now has 1.1K. It is about 3 years old and has averaged roughly 376 stars a year. It ranks #184 among C++ repositories and #2,488 across all languages on GitHubRepo.
Trending Record
4
DAYS ON TRENDING
#1616
BEST RANK
Sep 25, 2026
FIRST APPEARANCE
Active
STATUS TODAY
onnxruntime-genai has maintained a continuous presence across global trending indexes, peaking at #1616. Below is the 30-day activity profile:
💡 Overview
onnxruntime-genai is an open-source project written in C++: Generative AI extensions for onnxruntime.
Engineered for speed, consistency, and developer ease, it solves common hurdles in C++. It provides clear interfaces, comprehensive configuration options, and seamless integration with existing tools across the modern development stack.
⚡ Key Features
Optimized execution pipeline written in C++ for predictable speed.
Zero-friction configuration with comprehensive sensible defaults out of the box.
Cross-platform runtime support across Linux, macOS, and Windows environments.
Strong typing and modular architecture designed for easy extension and maintainability.
Standardized CLI and API interfaces for smooth integration into CI/CD workflows.
Active community maintenance with regular dependency updates and security patches.
📥 Installation
$ git clone https://github.com/microsoft/onnxruntime-genai.git
cd onnxruntime-genai⚙ System Requirements
Platforms
- • macOS
- • Linux
- • Windows
Runtime & Dependencies
C++20 compliant compiler (GCC 11+, Clang 13+, MSVC)
Architecture
x86_64, ARM64 (Apple Silicon & Graviton)
🧠 How It Works
onnxruntime-genai coordinates its core functionality through a modular C++ pipeline. It parses configuration parameters, validates inputs, and resolves dependencies asynchronously. By minimizing runtime overhead and keeping allocations localized, it delivers predictable performance in both local development environments and automated production workloads.
🎯 Production Use Cases
Production System Integration
Embed onnxruntime-genai into C++ backend services to handle core application logic.
CI/CD Automated Pipelines
Run automated validation, builds, and integration suites during deployments.
Developer Tooling & Workflows
Accelerate developer onboarding with pre-configured project utilities.
Open Source Extension
Fork and customize internal modules under the repository's open MIT license.
🚀 Getting Started
Install onnxruntime-genai using your package manager: `git clone https://github.com/microsoft/onnxruntime-genai.git`
Initialize your project workspace or configuration file for onnxruntime-genai.
Import onnxruntime-genai into your codebase or invoke it directly from your terminal.
Execute your test suite or run `onnxruntime-genai --help` to verify successful setup.
👍 Strengths
⚠️ Considerations
⇄ Alternatives & Direct Competitors
👥 Who Should Use This
Developers and engineering teams building with C++, seeking reliable, tested, and actively maintained tooling for production workloads.
🏆 Nearby in the Rankings
microsoft/onnxruntime-genai is currently ranked #2,488 by stars across every repository tracked on GitHubRepo. These are adjacent projects:
| Rank | Repository | Language | Stars | Action |
|---|---|---|---|---|
| #2,483 | JetBrains/android | Kotlin | ★ 1.1K | Compare ↗ |
| #2,483 | line/promgen | Python | ★ 1.1K | Compare ↗ |
| #2,483 | vincentlaucsb/csv-parser | C++ | ★ 1.1K | Compare ↗ |
| #2,483 | grizzlypeak3d/DJV | C++ | ★ 1.1K | Compare ↗ |
| #2,483 | sumimakito/Mac-Duo | Swift | ★ 1.1K | Compare ↗ |
| #2,488 | microsoft/onnxruntime-genai This Project | C++ | ★ 1.1K | |
| #2,489 | To3akaRin/mac-computer-use | JavaScript | ★ 1.1K | Compare ↗ |
| #2,490 | feincms/feincms | Python | ★ 1.1K | Compare ↗ |
| #2,490 | ergebnis/composer-normalize | PHP | ★ 1.1K | Compare ↗ |
| #2,492 | apache/ofbiz-framework | Java | ★ 1.1K | Compare ↗ |
| #2,492 | flagos-ai/FlagGems | Python | ★ 1.1K | Compare ↗ |
Frequently Asked Questions
What does onnxruntime-genai do? +
Generative AI extensions for onnxruntime
What language is onnxruntime-genai written in? +
The primary language is C++. Topics include: software.
Is onnxruntime-genai actively maintained? +
Yes, the last recorded push was on Sep 26, 2026 with 245 open issues being tracked.
How many stars does onnxruntime-genai have? +
onnxruntime-genai has 1,128 stars and 362 forks on GitHub.
How does onnxruntime-genai rank among GitHub repositories? +
With 1,128 stars, microsoft/onnxruntime-genai is ranked #2,488 globally across all repositories tracked on GitHubRepo and #184 among C++ projects.
What license is onnxruntime-genai distributed under? +
The repository reports a MIT license. Always verify the repository LICENSE file for legal terms.
