AI benchmark / Game-based evaluation
An AI strategy benchmark that pits frontier language models against each other in turn-based games and records decision logs and raw replays.
The page clearly presents a real AI benchmarking product with a defined purpose: comparing large language models in strategic games and ranking them with Glicko-2. It includes enough visible detail for a useful listing, including supported games, head-to-head match format, replay evidence, and match-cost context.
The snapshot shows a showcase/admin launch form, but not the broader benchmark catalog, published leaderboard examples, or documentation on how results are generated and validated. It also does not show whether visitors can run their own matches or only view completed exhibitions.
Last evaluated 112 days ago. Current rank #2055. Down 1 spot in the rankings.
A GitHub repo benchmarking TypeSafe’s Jev against Sonnet, GPT-5 nano, and local models on 770 Reddit AITA verdicts, with Brier scores, latency, and cost comparisons.
A benchmark for testing whether coding agents can show staff-level engineering judgment, not just produce correct code.
A crowdsourced benchmark that asks users to upload photos without obvious toilet signs and label where they would go to find the restroom, aiming to test whether AI can handle this kind of real-world visual inference.
