Developer Tools / AI Infrastructure
An open-source handbook for production LLM serving and inference at scale, covering GPU fundamentals, KV cache, batching, quantization, speculative decoding, and engines like vLLM, SGLang, and TensorRT-LLM.
The page clearly presents a focused AI infrastructure resource for people building or operating production LLM systems. The README shows substantial topic coverage, quick-start steps, and concrete chapters on serving, optimization, and scaling, which makes it useful as a public listing.
The snapshot shows the handbook structure, but it does not expose how much content is already written across all chapters, whether the labs are complete, or how actively the project is maintained beyond the latest commit and repo metadata.
Last evaluated 97 days ago. Current rank #1030. Down 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.
A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.
Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.
