Python

An open-source CLI for inspecting live LLM inference processes on NVIDIA GPUs. It breaks down VRAM usage by component, shows runtime and model details, and projects memory savings from quantization strategies.

A self-hosted Python runtime for building agentic AI apps with server-driven UI, audit logging, RBAC, sandboxing, and pluggable model orchestration.

A local Rust-plus-Python middleware layer for LLM apps that claims to reduce token usage and add in-process security checks before prompts are sent to a provider.

Wisp is an open-source desktop AI overlay that lets you trigger context-aware prompts with a hotkey, capture selection/clipboard/browser/screen context, and stream replies back into your workflow. It includes voice input/output, privacy controls, model-provider flexibility, and MCP support.

Soup is a Python library that routes Agent Skills into LLM prompts, injecting only the skills relevant to each request. It supports local skills, remote repositories, and multiple providers including OpenAI, Anthropic, Gemini, Ollama, LiteLLM, and LangChain.

Local-first Python SDK for AI agents that compresses web pages before LLM use, flattens Shadow DOM, builds action maps, and extracts structured data from tables, forms, and lists.

Autonomy is a self-directed AI agent framework under development by Bill Liu. The page describes a turn-based AgentLoop, managed action execution, beam-search candidate ranking, procedure skills, post-run learning, and event-sourced run history, with support for multiple AI providers and extensible toolsets.

Rudi is a Python tool for LLM memory management that replaces a growing chat transcript with a causal dependency graph, aiming to keep token usage flat across long sessions. The README shows benchmarking results, fold behavior, and example usage with get_slice, store_decisions, and run_turn.

VAEN is a CLI for packaging AI coding-agent setups into portable .agent archives and importing them across repos or teams without copying instructions, skills, MCP config, or secrets.

An agent-first web browser for automating web tasks, with Playwright integration and a CLI for browser control, page inspection, screenshots, navigation, and file actions.

A cognitive memory engine for AI agents with temporal decay, contradiction detection, autonomous consolidation, knowledge graph support, and ANN recall via HNSW. The repo shows Rust and Python usage, MCP client setup, and a quick-start path for agents and developers.

Flue is an open-source Python tool that lets coding agents control desktop software from the command line without MCP servers. The README says it works with apps like Photoshop, Blender, Unity, Houdini, and Microsoft Office, and supports harnesses such as Claude Code, Codex, Gemini CLI, Cursor, and OpenCode.

A local zero-dependency sandbox for agents that records files, commands, database activity, network access, and screenshots for review before approving changes.

Dependency-free Python library that compiles a declarative JSON query format into safe, parameterized SQL for LLM workflows, REST APIs, and frontend-backed data tables.

A local CLI tool that keeps Claude Code sessions warm by refreshing prompt cache during long subagent runs, aiming to reduce re-encoding costs in extended sessions.

A Python framework for local document search that replaces traditional embedding-based RAG with BM25 indexing, Meilisearch, and an agent loop for search, fetch, and citation-backed answers.

An open-source Python tool that turns multi-persona AI debate into pre-registered, time-anchored predictions and scores each seat against reality with Brier-style calibration. It includes a CLI, sample workflows, docs, and examples, plus a BYOK design for running on your own model key.

A Python/Flask code example that shows how to build a retrieval-augmented generation API with Telnyx embeddings and chat completions. The repo includes setup steps, environment variables, endpoint docs, and sample responses.

Open-source persistent memory agent for AI coding tools and assistants. It supports local and cloud setups, integrates with several agent IDEs and CLIs, and offers remember, recall, and answer primitives for long-term context.

MCP server for Unreal Editor that exposes a small MCP surface for a large set of editor automation tools. It supports blueprint editing, asset management, animation authoring, trace analysis, PIE actions, and Python execution, with setup notes for Unreal Engine 5.x and MCP-compatible clients.

Modular framework for building trading systems with a C++ core, polyglot strategy bindings, and an MCP server for AI coding agents.

Lightweight AI inference engine written in Rust for embedding local LLMs in mobile and desktop apps, with bindings for Python, Flutter, and React Native.

Open-source LLM uncertainty and hallucination detection tool that estimates epistemic risk in microseconds using exact-match normalized entropy, with Rust gateway and Python package support.

Ridge is a resource mesh for AI agents, with MCP, CLI, and Python access to local projects, Docker, SSH machines, and S3 storage. It focuses on delegated resource access, job coordination, and keeping artifacts out of model context.