llm-proxy

Self-hosted LLM proxy that redacts personal data before requests reach model providers, including inside tool-call arguments and multimodal content. It supports OpenAI-compatible clients, runs locally with zero telemetry, and uses Presidio plus an optional privacy filter for broader PII and secret detection.

DriftWatch AI is a proxy and middleware layer for LLM traffic that trims redundant tokens, validates JSON schemas, and monitors model drift across OpenAI, Anthropic, and Gemini workflows.

A model router for agentic systems that proxies Anthropic, OpenAI, Gemini, and OSS models through one endpoint, with hosted and self-hosted setup paths and direct integrations for Claude Code, Codex, Cursor, and opencode.

An OpenAI-compatible LLM proxy that routes requests to the fastest healthy provider. It runs as a small sidecar, supports latency/error-aware routing, session affinity, and Vertex AI, and can be deployed as a single static binary or Docker container.

FAAAH is a dependency-free, OpenAI-compatible local proxy that routes requests through text files and AI coding agents. It is aimed at developers who want to reuse an existing agent subscription as a backend for tools that expect the OpenAI API.

Kotro is a local control plane for coding agents that governs MCP tool actions and LLM traffic with one binary. The page shows install options, supported clients, dashboard access, and concrete controls like schema pinning, redaction, cache, budget, and circuit breaker behavior.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.