llm-gateway

Open-source LLM gateway that adds cost visibility, request tracing, repeated-call detection, and basic prompt-injection heuristics for OpenAI and Anthropic traffic.

A C++ OpenAI-compatible LLM gateway designed for very low latency, with support for translating requests to providers like Anthropic, Gemini, and Cohere.

A non-destructive compression gateway for AI coding agents that sits between the agent and the LLM API to reduce token usage while keeping original content recoverable on demand.

Open-source Rust LLM gateway for AI agents with full-fidelity traces, a tamper-evident audit ledger, offline verification, and in-request guardrails.

GreyFox Community Edition is a self-hosted AI traffic proxy and admin console for teams that want to control LLM usage, enforce per-user quotas, reuse cached responses, and keep traffic inside their own infrastructure.

Self-hosted OpenAI-compatible AI gateway with a CLI, server mode, and web UI for text, image, and audio workflows across many models and providers.

Open-source platform for governing AI usage across an organization, with MCP gateways, LLM gateways, hosted MCP servers, audit logs, and Claude Environments on Kubernetes.

Self-hosted LLM gateway and model router with OpenAI and Anthropic API compatibility, outbound provider routing, and eval-gated smart routing. It’s presented as a single static Go binary with zero telemetry and support for failover, caching, metrics, and local deployment.

Self-hosted LLM gateway for cost-aware model routing, spend tracking, and policy-based traffic control across multiple providers.

A local LLM gateway that redacts secrets before requests reach model providers and restores them locally afterward. It is aimed at agent workflows where prompts and tool calls may contain real credentials.