Developer Tools / Code Assistant
Open-source harness for measuring how consistently hosted LLM APIs return the same output across repeated runs and over time, with raw transcripts, scoring, and a static leaderboard generator.
The page clearly describes an AI-adjacent developer tool with a specific purpose: benchmarking reproducibility of hosted LLM APIs at the byte level. The README shows quickstart instructions, scoring workflow, supported providers, methodology, and the fact that results are recomputable from raw transcripts, which is enough evidence for a useful public listing.
The snapshot cuts off before the full README ends, so it is hard to verify the complete scope of supported cases, current maintenance status, and whether there are ready-made example runs or published results beyond the reference leaderboard described here.
Last evaluated 10 days ago. Current rank #834. Down 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.
A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.
Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.
