High-performance single-GPU inference for selected model checkpoints and GPUs.
Star History
Momentum
+62
STARS · LAST 30 DAYS
2
PER DAY
#114
MOST-STARRED C++
| Window | 7 days | 30 days | 90 days |
|---|---|---|---|
| Stars gained | +14 | +62 | +180 |
| Per day | 2 | 2 | 2 |
| Forks gained | +2 | +10 | +24 |
ninfer gained 62 stars in the last 30 days, about 2 a day, and now has 2.5K. It is about 1 year old and has averaged roughly 2.5K stars a year. It ranks #114 among C++ repositories and #1,664 across all languages on GitHubRepo.
Trending Record
1
DAYS ON TRENDING
#2082
BEST RANK
Sep 28, 2026
FIRST APPEARANCE
Active
STATUS TODAY
ninfer has maintained a continuous presence across global trending indexes, peaking at #2082. Below is the 30-day activity profile:
💡 Overview
ninfer is an open-source project written in C++: High-performance single-GPU inference for selected model checkpoints and GPUs.
Engineered for speed, consistency, and developer ease, it solves common hurdles in C++. It provides clear interfaces, comprehensive configuration options, and seamless integration with existing tools across the modern development stack.
⚡ Key Features
Optimized execution pipeline written in C++ for predictable speed.
Zero-friction configuration with comprehensive sensible defaults out of the box.
Cross-platform runtime support across Linux, macOS, and Windows environments.
Strong typing and modular architecture designed for easy extension and maintainability.
Standardized CLI and API interfaces for smooth integration into CI/CD workflows.
Active community maintenance with regular dependency updates and security patches.
📥 Installation
$ git clone https://github.com/Neroued/ninfer.git
cd ninfer⚙ System Requirements
Platforms
- • macOS
- • Linux
- • Windows
Runtime & Dependencies
C++20 compliant compiler (GCC 11+, Clang 13+, MSVC)
Architecture
x86_64, ARM64 (Apple Silicon & Graviton)
🧠 How It Works
ninfer coordinates its core functionality through a modular C++ pipeline. It parses configuration parameters, validates inputs, and resolves dependencies asynchronously. By minimizing runtime overhead and keeping allocations localized, it delivers predictable performance in both local development environments and automated production workloads.
🎯 Production Use Cases
Production System Integration
Embed ninfer into C++ backend services to handle core application logic.
CI/CD Automated Pipelines
Run automated validation, builds, and integration suites during deployments.
Developer Tooling & Workflows
Accelerate developer onboarding with pre-configured project utilities.
Open Source Extension
Fork and customize internal modules under the repository's open Apache-2.0 license.
🚀 Getting Started
Install ninfer using your package manager: `git clone https://github.com/Neroued/ninfer.git`
Initialize your project workspace or configuration file for ninfer.
Import ninfer into your codebase or invoke it directly from your terminal.
Execute your test suite or run `ninfer --help` to verify successful setup.
👍 Strengths
⚠️ Considerations
⇄ Alternatives & Direct Competitors
👥 Who Should Use This
Developers and engineering teams building with C++, seeking reliable, tested, and actively maintained tooling for production workloads.
🏆 Nearby in the Rankings
Neroued/ninfer is currently ranked #1,664 by stars across every repository tracked on GitHubRepo. These are adjacent projects:
| Rank | Repository | Language | Stars | Action |
|---|---|---|---|---|
| #1,659 | vinzdg/codenotch | Swift | ★ 2.5K | Compare ↗ |
| #1,660 | aspnet-contrib/AspNet.Security.OAuth.Providers | C# | ★ 2.5K | Compare ↗ |
| #1,661 | paratestphp/paratest | PHP | ★ 2.5K | Compare ↗ |
| #1,662 | cloudnativelabs/kube-router | Go | ★ 2.5K | Compare ↗ |
| #1,663 | mercurius-js/mercurius | JavaScript | ★ 2.5K | Compare ↗ |
| #1,664 | Neroued/ninfer This Project | C++ | ★ 2.5K | |
| #1,664 | symfony/security-bundle | PHP | ★ 2.5K | Compare ↗ |
| #1,666 | CopilotKit/openmuse | TypeScript | ★ 2.5K | Compare ↗ |
| #1,667 | fooyin/fooyin | C++ | ★ 2.5K | Compare ↗ |
| #1,668 | BrighterCommand/Brighter | C# | ★ 2.5K | Compare ↗ |
| #1,669 | inertiajs/inertia-laravel | PHP | ★ 2.5K | Compare ↗ |
Frequently Asked Questions
What does ninfer do? +
High-performance single-GPU inference for selected model checkpoints and GPUs.
What language is ninfer written in? +
The primary language is C++. Topics include: software.
Is ninfer actively maintained? +
Yes, the last recorded push was on Sep 28, 2026 with 106 open issues being tracked.
How many stars does ninfer have? +
ninfer has 2,489 stars and 478 forks on GitHub.
How does ninfer rank among GitHub repositories? +
With 2,489 stars, Neroued/ninfer is ranked #1,664 globally across all repositories tracked on GitHubRepo and #114 among C++ projects.
What license is ninfer distributed under? +
The repository reports a Apache-2.0 license. Always verify the repository LICENSE file for legal terms.
