Discover the best AI Evaluation open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.
[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
[Public preview] The first public quant trading benchmark scored against what professional traders actually made on the same asset
[Public preview] An advanced AI Benchmark for math, produced by mathmo at St John's College, Cambridge.
[Public preview] Hard human-written reasoning puzzles: 749 answered items in 15 topics (707 scored core), with protocol and scorer.