local-llm

An interactive guide for choosing local AI hardware and matching open-weights LLMs to specific builds. It offers budget-based build recommendations, a hardware picker, model-to-hardware compatibility, and a state-of-the-local-AI snapshot.

CrankGPT is a fully offline voice assistant built on a hand-crank-powered Raspberry Pi setup. The page explains the hardware stack, local speech recognition, on-device LLMs, text-to-speech, power smoothing, and latency measurements for running the system without cloud dependency.

Lightweight AI inference engine written in Rust for embedding local LLMs in mobile and desktop apps, with bindings for Python, Flutter, and React Native.

A Mojo port of the Pi AI Agent Toolkit with a set of runnable examples for chat, coding agents, tool calling, web research, and long-running agent loops.

A detailed walkthrough for running a local coding agent on macOS with llama.cpp, Gemma 4, MTP speculative decoding, image support, and Pi as the agent interface.

A local AI coding harness that turns business-rule specs into a constrained JSON AST, validates it, and compiles it into Clojure code while logging generation and repair artifacts.

Enough is a beta personal language system for planning, writing, reviewing, and translation. It supports local models and OpenRouter, and is aimed at users who want more control over their data while building a flexible personal knowledge workflow.

An open-source Python project that uses a local 7B diffusion language model to make real-time Gymnasium decisions with zero training. The README shows install steps, a code example, and benchmark-style results across several environments.

A blog post about an experimental local LLM system where three qwen3.5:9b agents run autonomously, maintain stress states, self-modify capabilities, and coordinate through a shared OS-like layer.