local-ai

Sageling is a local Mac AI assistant built for everyday work. It runs on Apple Silicon Macs, keeps files and conversations on-device, and is positioned for privacy-sensitive tasks like notes, grading, and legal or healthcare workflows.

An open 30B agentic model from Meta designed to run locally on consumer hardware for coding, function calling, and other always-on agent workflows.

A 30-second WebGPU benchmark that measures a device’s memory-bandwidth ceiling for local AI and checks for a WebGPU subgroup correctness bug, with receipts, projections, and comparison data.

Aloud is a macOS tool that reads Claude Code and OpenAI Codex replies out loud using local text-to-speech. It includes session-level controls, keyboard shortcuts, hook integration, and a clear install flow for developers.

A Go-based local orchestration platform for AI coding agents, with live event streaming, session replay, and durable execution history.

ImageSage is a private, local AI gallery for Windows that lets you search photos by visual content or text in images, then review AI-generated rename suggestions and manage files in place.

A Windows voice-dictation app in Rust that runs locally with whisper.cpp, supports hotkey dictation, system audio capture, file transcription, and optional local LLM cleanup.

Lucidos is a local AI OS and companion that keeps described apps running, responds to events, and works from a persistent desktop or browser-based interface. The repo shows install paths for macOS and Linux, a headless runtime, source build instructions, and a clear focus on user-owned local data.

Native Zig inference server for Apple Silicon Macs that runs local LLMs with MLX and GGUF support, plus OpenAI- and Anthropic-compatible APIs. The page highlights one-click local setup, Ollama compatibility, agent tools, MCP support, and performance claims against LM Studio.

SnapName is a macOS app that watches a screenshot or image folder and uses bundled local AI to suggest better filenames without uploading images.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

Otlet is a Postgres extension for running local LLM inference next to database rows. The README shows SQL examples, model registration, task execution, and an entity-resolution workflow with typed outputs.

wavecat is a fully local personal agent that watches your screen and runs entirely on-device. The page explains its privacy focus, hardware requirements, local model setup, and supported platforms.

A fully local voice-controlled 3D sandbox where a sassy robot turns spoken commands into voxel builds. The repo explains the stack, runtime requirements, service contracts, controls, and tests.

Open-source local AI coworker system that routes Claude Code and Codex work to local models on your own hardware, with durable task handling, multi-machine cooking, and MCP/CLI support.

Symbio is a local AI assistant that learns from user corrections, builds training data from notes, and can fine-tune itself over time. It supports file operations, sandboxed shell commands, RAG, a Telegram bot, and a demo with MoA and skill adapters.

A private AI meeting-notes app that transcribes calls locally and uses Codex, Claude Code, or a local LLM to generate summaries and action items on-device.

Wolffish is a local desktop AI agent that runs on a user’s machine with full system access. It emphasizes offline operation, Markdown-based memory/brain files, and simple skill-based extension via SKILL.md.

QVAC SDK 0.12.0 adds TurboQuant, a KV-cache quantization feature for local LLM inference that claims up to 5x more context on-device with no retraining or code changes.

A local-first AI memory engine for asking questions over selected files on your computer using Ollama, embeddings, and a custom vector database.

Harbor is a local AI stack and launcher for starting pre-configured agentic coding tools against different backends, with support for tools like Codex, OpenCode, Claude Code, and web-enabled workflows.

Local push-to-talk dictation for macOS that uses Whisper, stays on-device, and pastes text at the cursor.

Local privacy gateway that redacts sensitive text before sending prompts to external LLMs, then reconstructs the final answer locally.

A browser-based clicker game where local AI builds a custom game from your idea entirely on-device via WebGPU, with no API keys or servers.