Developer Tools / AI/LLM Inference
A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code.
The crawl snapshot gives enough evidence that this is a real AI developer project: it explains the KV fragment approach, shows engine adapters, lists Android and Go code, and includes benchmark and architecture details. It is clearly aimed at builders working on local LLM inference, not a thin placeholder.
The snapshot does not show installation steps, a quickstart, or a runnable demo, so a visitor still cannot tell how to try it locally. Maintenance signals are also limited in the crawl, beyond the file list and commit count.
Last evaluated 73 days ago. Current rank #1736. Up 6 spots in the rankings.
CodeGraph is a local code knowledge graph for AI coding agents like Claude Code, Cursor, Codex, OpenCode, and Hermes Agent. It aims to cut token use, tool calls, and runtime by letting agents query pre-indexed code structure instead of scanning files repeatedly.
Mercemur is a store automation platform with three interfaces: a REST API, an MCP server for AI agents, and a CLI for editing storefronts as files. The docs show authentication, scopes, rate limits, error handling, pagination, idempotency, and a large API surface for catalogue, orders, customers, pricing, and money.
A zero-dependency C++23 CLI and MCP server that gives coding agents a ranked map of a repository, including call context, blast radius, and tests to run.
Traccia is an AI agent observability and governance platform with OpenTelemetry-native tracing, runtime policy enforcement, prompt registry, evals, cost attribution, and compliance evidence export.
