on-device-ai

Omni is a local-first semantic search app for macOS that indexes text, code, PDFs, images, audio, and video on-device. It supports multilingual search, private offline use, and exposes a local endpoint for agents to query indexed files.

Open-source project showing how to run a 28.9M-parameter language model on an ESP32-S3 microcontroller, with on-device inference, firmware, wiring, training code, and measured results.

Browser extension that scans pastes for credentials and PII before they reach LLM chat sites, with local on-device inference and no network calls.

Vehla is a native macOS command center with on-device AI, clipboard intelligence, window management, dictation, and local-first workflows. It combines launcher-style actions, clipboard recall, shelves, workspace tools, and model connectivity in one app.

Privacy-first AI meeting notes and writing assistant for macOS, with on-device transcription, smart minutes, action items, and AI writing tools. The repo also shows an opt-in plain Markdown storage mode and full source for the app.

Recly turns an Apple Watch or Galaxy Watch into a recorder, transcribes locally or with your own API key, and stores files in your Google Drive with no Recly server in the middle.

An offline desktop time tracker for Windows and macOS that automatically logs app and website activity, classifies work locally with on-device AI, and helps prepare client invoices without cloud syncing or manual timers.

A macOS command-line tool for on-device AI and voice tasks, including speak, listen, transcribe, chat, and an OpenAI-compatible local server.

Open-source project that ports Google DeepMind’s Magenta RealTime 2 music generation to Core ML for local execution on iPhone, with Apple Neural Engine acceleration and no GPU use.

LocalCode turns plain English into CLI commands on Apple Silicon Macs using Apple’s on-device Foundation Models framework, then asks for approval before running them.

A native macOS markdown writing app for plain .md notes on your own disk, with on-device AI search and semantic lookup.

An Android-focused on-device AI agent fork that can automate phone actions, run workflows and schedules, and be controlled locally or through Telegram.

A suite of three native macOS apps: Crest for notch-based control, Take for screen recording, and Minutes for on-device meeting notes. The page emphasizes offline use, local processing, one-time pricing, and how the apps work together on a MacBook notch.

A browser-based brainstorm canvas that grows ideas from a seed word using Chrome’s on-device AI, with no signup or backend.

An iPhone and iPad dictation app that cleans up speech into formatted text, with on-device or cloud transcription and a meeting bot that drafts follow-up emails.

A draft specification for an offline emergency dispatch protocol designed for on-device AI models on phones when no dispatcher is available.