Python

A pure-Python LLM inference engine and server with CUDA/HIP/Metal code generation, OpenAI-compatible API support, built-in RAG, and multi-GPU backend support.

tokentoll is a GitHub Action and CLI that scans Python and JavaScript/TypeScript code for LLM API calls, estimates spend, and blocks pull requests when cost or model-policy thresholds are exceeded.

SLayer is an open-source semantic layer for AI agents and humans that sits between a database and downstream tools. It can auto-create data models from schema, compile natural-language-style queries into SQL, and be used through MCP, REST, CLI, or Python.

A Claude Code status line that shows session size, next-turn cost, and remaining budget before you type.

FastAPI-based server that turns files and Python modules into REST APIs, browsable UIs, searchable resources, and an MCP endpoint.

Local-first debugger for LLM agent context windows. It records each call’s context into a single-file trace so you can inspect, diff, and share what the model actually saw turn by turn.

Local CLI for analyzing when a coding agent starts degrading as session context fills, using transcript data already stored on disk.

AutomatiQ is a Python CLI that records a browsing session and uses vision and LLM steps to generate a standalone HTTP-based automation script.

An open-source Python support agent that uses SynapCores as the agent brain for memory, retrieval, semantic tool routing, and generation. The repo includes a quick start, local Docker setup, example commands, and a traced demo of the agent loop.

Klent is an AI agent guardrails product that sits between agents and their tools, letting teams allow, deny, pause, rewrite, or redirect tool calls with policies, human approval flows, and audit trails.

Open-source harness for executable security regression testing of agentic applications and MCP-integrated systems, with scenario files, policy assertions, trace-based evaluation, and JSON output for CI or local use.

A Python SDK that provides LiteLLM-style model routing and translation with a smaller surface area. It supports completions, streaming, embeddings, tool calling, async variants, provider mapping, and local OpenAI-compatible backends.

LeanGuard is a Lean 4-based runtime guardrail system for agent tool use, with native temporal policies, Python integration, and optional MCP support.

Hedgemony is a Python tool that checks AI-written code for fabricated packages, invented APIs, impossible calls, and contradictions between code and stated examples, using interpreter and registry checks rather than another model.

Weir is a CI gate for AI agents that reads OpenTelemetry traces and fails builds when sensitive data reaches forbidden sinks. It includes a gauge for trace coverage, taint tracking, HTML reports, and rule-based scans for agent workflows.

Crilio is a Python CLI and CI gate for testing AI prompts and catching regressions before they ship. It versions prompt tests in crilio.yaml, runs model calls, uses a judge model to score responses, and can block pull requests in GitHub Actions when checks fail.

LayoutLens is an AI-assisted UI testing tool that combines natural-language visual checks with deterministic WCAG audits using axe-core and Playwright. It supports keyless accessibility scans, hybrid LLM-grounded checks, a Python API, and a CLI for running tests in CI.

StateM is a Python CLI for managing long-running AI agents with explicit states, transition checks, runtime history, and resume/compaction support. The repo shows installation, quick-start commands, and a concrete coding-agent runbook example.

A Python computer vision tool that analyzes gameplay videos, detects key events, clips highlights, and generates session reports and montages.

FAAAH is a dependency-free, OpenAI-compatible local proxy that routes requests through text files and AI coding agents. It is aimed at developers who want to reuse an existing agent subscription as a backend for tools that expect the OpenAI API.

Open-source runtime guardrails for AI agents that intercept unsafe tool calls before they execute, aiming to block prompt-injection-driven exfiltration and other policy violations.

Open-source security research tool for auditing Python AI agents and codebases with AST analysis and Docker-based runtime verification.

Open-source runtime action grounding framework for AI agents. It verifies proposed agent actions against live systems of record before execution and can return allow, hold-for-human, or block decisions.

Open-source input scanner for AI agents that strips hidden instructions and scans text, files, images, PDFs, QR codes, audio, and video before they reach an agent.