llm

Anthropic’s Claude API platform for building AI products, apps, and agent workflows with Claude models, built-in tools, pricing tiers, and developer docs.

WebLLM is a high-performance in-browser LLM inference engine that runs locally in the browser with WebGPU acceleration. It exposes an OpenAI-compatible API, supports streaming and JSON mode, and includes examples for building chat apps and browser extensions.

A self-hosted Docker Compose stack for running local AI services including Ollama, LiteLLM, Whisper, Kokoro, embeddings, and an MCP Gateway.

Open Bias is an open-source reliability harness for LLM apps and agents that enforces rules at runtime. It sits between your app and an LLM provider, using RULES.md policies to trace, block, or fix off-policy behavior.

Browser extension that scans pastes for credentials and PII before they reach LLM chat sites, with local on-device inference and no network calls.

AutoRound is an open-source quantization toolkit for LLMs and VLMs, focused on high-accuracy low-bit inference across CPU, XPU, CUDA, and multiple deployment backends.

An OTP-native Elixir library for building AI agents, durable LLM workflows, retrieval pipelines, and production LLM services.

Lowfat is a lightweight CLI tool that filters noisy command output before it reaches an AI agent, with plugins, shell integration, and usage stats for token savings.

Google’s Gemini 3.5 Flash announcement describes a frontier model aimed at agents and coding, with notes on speed, multimodal generation, and availability through the Gemini app, Google Antigravity, Gemini API, AI Studio, Android Studio, and Gemini Enterprise.

LLMCap is a proxy for LLM API calls that hard-stops requests when a dollar cap is reached, with support for major providers and companion tools for VS Code, CLI, and Windows.

An open-source CLI for testing LLM prompts across consistency, latency, cost, and behavior, with HTML reports and support for OpenAI and Anthropic.

oruk is a live broadcast intelligence API for real-time news. It offers REST endpoints, SSE streaming, webhooks, and an MCP server for use in AI apps and developer workflows.

Open-source terminal coding agent in Rust with LLM-native code understanding, shell safety, multi-provider support, and automatic failover.

Python package for recording real LLM API responses and replaying them in tests so LLM-driven code can run deterministically without live API calls.

An AI API gateway/proxy in Go that sits between coding clients and upstream LLM providers, with request routing, secret redaction, context handling, MCP tool integration, and transparent SSE streaming.

tokentoll is a GitHub Action and CLI that scans Python and JavaScript/TypeScript code for LLM API calls, estimates spend, and blocks pull requests when cost or model-policy thresholds are exceeded.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

SwarmWright is a self-hosted multi-agent AI orchestration platform for designing, running, and inspecting swarms of agents from markdown and config. The page highlights Docker-based setup, topology-enforced agent graphs, human approval steps, local storage, and detailed audit logs.

A Go-based text editor built for LLM agents, with branching undo, conflict handling, audit logs, MCP support, and agent skills installation.

AutomatiQ is a Python CLI that records a browsing session and uses vision and LLM steps to generate a standalone HTTP-based automation script.

An interactive guide and demo for prompt engineering that shows how analogies, examples, and format-matching can improve LLM outputs.

Open-source Go runtime for autonomous multi-agent systems. Swarm models work as durable state machines, persists state, supports replay/fork, and integrates with multiple LLM backends.

Strict Go static analyzer built for LLM-written code, with opinionated checks, annotation-based exceptions, caching, and Claude Code hook integration.

Rudi is a Python tool for LLM memory management that replaces a growing chat transcript with a causal dependency graph, aiming to keep token usage flat across long sessions. The README shows benchmarking results, fold behavior, and example usage with get_slice, store_decisions, and run_turn.