Developer Tools / AI Benchmarking
DeepSWE is a benchmark for measuring frontier coding agents on original, long-horizon software engineering tasks. The page shows a leaderboard, methodology overview, task examples, and a full blog explaining the benchmark design and results.
The page clearly presents an AI-adjacent developer tool: a benchmark for evaluating coding agents. It includes enough public-facing evidence to be useful in a directory listing, including the benchmark purpose, a leaderboard with model scores, task examples, and methodological claims about contamination-free tasks and hand-written verifiers.
This snapshot does not show the full dataset, an API or downloadable evaluation package, or a direct way for visitors to run DeepSWE themselves from the page. The exact verification workflow and benchmark access details are only partially described here.
Last evaluated 106 days ago. Current rank #1046. Down 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.
A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.
Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.
