llm

NeatContext is a local-first desktop workspace that adds team-specific knowledge and read-only internal tools to LLMs so they can give grounded operational answers. The page shows incident-response examples, Markdown-based profiles, MCP integration, and support for multiple model providers.

LocalMask is a local-first privacy layer for AI coding that scans repos on-device, masks secrets and PII into reversible tokens, and forwards only safe content to models like Claude, GPT, or Gemini. It also supports masked repo mirrors, an AI proxy, and a CLI/MCP workflow.

CLI tool for versioning, diffing, rolling back, and searching AI prompts, with Git-style workflows for prompt management.

Open-source AI agent monitoring platform with tracing, issue grouping, evals, semantic search, alerts, and MCP access for coding agents.

An OTP-native Elixir library for building AI agents, durable LLM workflows, retrieval pipelines, and production LLM services.

Lowfat is a lightweight CLI tool that filters noisy command output before it reaches an AI agent, with plugins, shell integration, and usage stats for token savings.

Google’s Gemini 3.5 Flash announcement describes a frontier model aimed at agents and coding, with notes on speed, multimodal generation, and availability through the Gemini app, Google Antigravity, Gemini API, AI Studio, Android Studio, and Gemini Enterprise.

LLMCap is a proxy for LLM API calls that hard-stops requests when a dollar cap is reached, with support for major providers and companion tools for VS Code, CLI, and Windows.

An open-source CLI for testing LLM prompts across consistency, latency, cost, and behavior, with HTML reports and support for OpenAI and Anthropic.

oruk is a live broadcast intelligence API for real-time news. It offers REST endpoints, SSE streaming, webhooks, and an MCP server for use in AI apps and developer workflows.

Portus is a Rust-based API and AI gateway for Kubernetes that handles HTTP, LLM, and MCP traffic on one data plane. The page shows Gateway API conformance, performance benchmarks, AI key and budget controls, and MCP routing examples.

Open-source structured memory for AI agents. Ingot stores tool results and documents in SQL-friendly form, with optional embeddings, MCP access, and a local quick start for running the stack.

Anthropic’s documentation page on how to prompt Claude Opus 5.5, with guidance for effort calibration, agentic runs, progress updates, multi-app workflows, refusals, pasted text, and visual inputs.

A local proxy that inspects LLM requests and attachments for secrets before they reach the model, with redaction, rejection modes, and local attachment decoding/OCR.

A browser extension that lets users move AI chat threads between ChatGPT, Claude, and Gemini without retyping. It supports exporting/importing local .chatbridge files and emphasizes browser-only, local-first handling.

A two-part self-study course for building a tiny LLM stack from scalar autograd to a working chat assistant, with modules covering transformers, pretraining, instruction tuning, retrieval, tool use, and agent loops.

A Python framework for building AI agents as Python objects, with typed methods, stateful fields, and LLM-driven agentic methods. The repo includes installation steps, a quick start, examples, and notes on supported models and safety boundaries.

TokenPath is an API for token-level citations and attribution for LLM outputs. It resolves claims in generated answers back to source spans, uses attention-based tracing, and includes an endpoint for raw heatmaps.

VS Code extension that helps review large AI-generated diffs with local call graphs, file dependency graphs, and review cards that show blast radius and context before changes are pushed.

fenic is an open-source Python framework for semantic DataFrames, letting you use LLM-powered operators like extract, classify, summarize, and embed inside query pipelines.

Open-source terminal coding agent in Rust with LLM-native code understanding, shell safety, multi-provider support, and automatic failover.

Python package for recording real LLM API responses and replaying them in tests so LLM-driven code can run deterministically without live API calls.

Open-source Windows desktop AI assistant for local and cloud models. It supports chat, coding workflows in project folders, web browsing, file access, voice mode, local document retrieval, MCP integrations, and optional OpenAI-compatible/API provider connections.

Open-source, self-hosted analytics for MCP servers with dashboards for tool calls, latency, failures, client usage, releases, and exports.