Benchmark GitHub Repositories (2026) · Open Source Tools

Offline cyber security agent for your apps and AI coding tools. Open R&D: measured in public, improved every release.

[Public preview] The first public quant trading benchmark scored against what professional traders actually made on the same asset

[Public preview] An advanced AI Benchmark for math, produced by mathmo at St John's College, Cambridge.

[Public preview] Hard human-written reasoning puzzles: 749 answered items in 15 topics (707 scored core), with protocol and scorer.

A dishwasher-loading game on a physical simulation of one real machine, built to benchmark language models and playable in a browser. The game inside is called Spotless.

The online judge for the LLM era. Every case is a real customer delivery: you work it with a coding agent, and your system is judged once it is live.

OWASP VulnerableApp Project: Break it. Scan it. Reproduce it. Benchmark against it. Improve it.