Developer Tools / AI Proxy / LLM Gateway

smol-llm-proxy

A lightweight API key proxy for self-hosted llama.cpp servers with per-user token usage tracking, rate limiting, and multi-server routing.

Clear28/30
Useful28/30
Specific16/20
Complete16/20
smol-llm-proxy screenshot

Why it was accepted

The page clearly describes an AI-adjacent developer tool with a specific job: proxying requests across multiple llama.cpp servers while handling per-user keys, routing, rate limits, and usage logging. The README shows real implementation details, quick start steps, example commands, and a concrete architecture, which is enough for a useful public listing.

Weakness

The crawl shows the core purpose and setup, but it does not fully show production maturity details like releases, issue activity, screenshots, or long-term maintenance status. It also leaves open how routing behaves in edge cases and what admin workflows look like beyond basic key creation.

Review status

42 days ago #244 ↓ -3

Last evaluated 42 days ago. Current rank #244. Down 3 spots in the rankings.

Score history

88

Related listings

CodeGraph screenshot
94

Developer Tools / AI for Code

CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.

Mercemur screenshot
93

Developer Tools / API / AI Agent Infrastructure

Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.

ripwire screenshot
#5 ripwire
92

Developer Tools / Code Assistant

A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.

Traccia screenshot
#6 Traccia
92

Developer Tools / Code Assistant

Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.