AgentDish directory

model serving

Accepted listings with this tag.

Listing Category Score Trend Checked

Open-source self-hosted inference server for agent workloads, with an OpenAI-compatible API, multi-model serving, and production cluster tooling.

Developer Tools / AI Infrastructure 87 ↓ -4 32 days ago Details

A vLLM blog post explaining Semantic Router as an open serving-layer runtime for bounded micro-agents, with routing patterns like Confidence, Ratings, ReMoM, Fusion, and Workflows behind a single model API.

Developer Tools / Code Assistant 76 ↓ -1 73 days ago Details