AgentDish directory
AI benchmark AI Tools
Accepted listings in this category.
| Listing | Category | Score | Trend | Checked | |
|---|---|---|---|---|---|
#1120
↓ -6
Jev vs. LLMs on 770 AITA posts
A GitHub repo benchmarking TypeSafe’s Jev against Sonnet, GPT-5 nano, and local models on 770 Reddit AITA verdicts, with Brier scores, latency, and cost comparisons. |
AI benchmark / LLM Evaluation | 84 | ↓ -6 | 44 days ago | Details |
#1478
↓ -3
sudo L7
A benchmark for testing whether coding agents can show staff-level engineering judgment, not just produce correct code. |
AI benchmark / Coding benchmark | 83 | ↓ -3 | 18 days ago | Details |
#2055
↓ -1
System 2 Arena
An AI strategy benchmark that pits frontier language models against each other in turn-based games and records decision logs and raw replays. |
AI benchmark / Game-based evaluation | 80 | ↓ -1 | 112 days ago | Details |
#2472
↓ -1
ToiletBench
A crowdsourced benchmark that asks users to upload photos without obvious toilet signs and label where they would go to find the restroom, aiming to test whether AI can handle this kind of real-world visual inference. |
AI benchmark / Multimodal evaluation | 74 | ↓ -1 | 12 days ago | Details |