local inference

Google’s Gemma 4 12B is a multimodal model for local and developer-focused AI use, with native audio and vision support, agentic workflows, and broad tooling support.

PipeCrab is an open-source Rust pipeline for building voice agents, with local inference support and examples that show end-to-end audio, transcription, LLM, and TTS flows.

A long-form technical guide on running local LLMs in the browser, with checks for WebGPU support, model hashes, tokenizer matching, and browser-side data leakage.

Glass is an always-on screen recording app that uses secure, local inference on Apple’s Neural Engine to enrich personal context for you and your agent.

SlopGuard is a desktop Chrome extension that scans images on webpages for AI generation signals using local detection methods, including metadata, SynthID, and a visual classifier.

A field note about testing a coding agent fully offline on a laptop with Ollama and Qwen3.8 27B, including the setup, failure modes, and the workaround that made the project finish.