llm

Open-source transparent proxy for coding agents that preserves full conversation history on disk while selectively deciding what the model reads. Supports OpenAI-compatible, Anthropic Messages, and OpenAI Responses APIs, with setup docs, engine-specific configs, and benchmark claims for long-horizon agent sessions.

Mantid is a Mac app for training custom ML models and LLMs on local data. It can work with spreadsheets, PDFs, emails, and documents, test results against a baseline, version models, and export them for use in other tools.

A Swift package for running JavaScript LLM agents inside a Swift app using the XS engine, with snapshot/restore support, resident agents, and confined tool access.

Chrome extension that captures a fixed screen region, runs offline OCR with bundled Tesseract, and exports page-by-page text for use with LLMs or search.

A pure C implementation for training and running a tiny GPT, with build instructions, sample output, and performance notes for macOS, Linux, and Windows.

clai is a terminal-first AI tool that pipes stdin to an LLM and writes results to stdout, so it fits naturally into shell workflows like git diffs, text files, and command pipelines.

Self-hosted OpenAI-compatible mock server for testing LLM integrations without exposing API keys. Includes a hosted instance, local setup, Docker support, streaming, and deterministic responses.

Local-first debugger for LLM agent context windows. It records each call’s context into a single-file trace so you can inspect, diff, and share what the model actually saw turn by turn.

A hands-on kit for authorized red teaming of locally run LLMs, with jailbreak techniques, prompt-injection scenarios, streaming attack visualization, and support for OpenAI-compatible local model servers.

Gnoseed is a free spaced-repetition flashcard platform for developers, focused on Kubernetes, DevOps, AI, cloud, and certification prep. It includes 3,924+ practice questions, 47 topic decks, offline use, and learning paths for roles and exams.

A local-first CLI that compresses application logs into a token-optimized Markdown/JSONL summary for LLMs.

A local-first, self-hosted home assistant that runs a local LLM as a single brain for Home Assistant, voice, memory, reminders, media control, and other scoped tools.

AutomatiQ is a Python CLI that records a browsing session and uses vision and LLM steps to generate a standalone HTTP-based automation script.

An interactive guide and demo for prompt engineering that shows how analogies, examples, and format-matching can improve LLM outputs.

Open-source Go runtime for autonomous multi-agent systems. Swarm models work as durable state machines, persists state, supports replay/fork, and integrates with multiple LLM backends.

Strict Go static analyzer built for LLM-written code, with opinionated checks, annotation-based exceptions, caching, and Claude Code hook integration.

A research project exploring multi-agent LLM coordination in Pokémon Showdown. It compares talk modes, reports win rates and token costs, and frames the environment as a benchmark for studying collaboration between agents.

Open-source semantic layer for warehouses that infers table, column, join, and business-rule metadata, then serves it to AI agents through MCP and CLI checks.

An open-source browser extension for creating and managing userscripts by chatting with an LLM. It inspects the current page, writes and tests scripts live, supports multiple model providers, and can export, import, and run mods across supported browsers.

A GitHub repo benchmarking TypeSafe’s Jev against Sonnet, GPT-5 nano, and local models on 770 Reddit AITA verdicts, with Brier scores, latency, and cost comparisons.

A public guide to principles for building reliable LLM applications and production-ready agents. The page lays out 12 factors, with discussion of tool calls, context windows, control flow, human handoff, and state handling.

ThreadShelf is a local-first archive and semantic search tool for AI conversations, with support for ChatGPT, Claude, Gemini, Grok, OpenRouter, LM Studio, and Google AI Studio. It can reconstruct threads, export conversations to Markdown, and continue chats through local llama.cpp or OpenRouter.

A web calculator that estimates the electricity use and carbon emissions of AI token usage, with everyday comparisons, example workloads, and a detailed methodology page.

Open-source text-to-SQL engine tuned to your own database, with configurable pipeline stages, policy checks, and an evaluation harness for measuring performance on real schemas.