llm

A detailed technical write-up about training a 3.8B-parameter language model from scratch, including setup, throughput improvements, ablations, benchmarks, and cost/performance results.

A lightweight Markdown variant designed to reduce token usage for LLM consumption using single-character markers and context-aware parsing.

A DeepSeek Harness plugin that uses an LLM to verify and rank candidate outputs with select, compare, track, and rollout tools.

Vomit is a Go-based CLI that converts Claude output into readable English by sending it through a separate local LLM. It supports install/setup commands, a scrub mode for Claude hooks, and sidecar commands for listing and tailing sessions.

A pricing analysis article comparing batch API discounts across Google, OpenAI, Anthropic, xAI, and OpenRouter, with a focus on where batch rates differ from standard pricing.

HyperSAE is a Python package for mechanistic interpretability that trains hyperbolic sparse autoencoders on LLM activations. The page includes installation steps, a quickstart example, benchmark tables, and a short software architecture overview.

OneRingAI is an open-source TypeScript library for building AI agents with integrations and graph memory. The repository shows a substantial codebase with docs, setup files, testing, MCP-related material, and references to supported models and multimodal capabilities.

An open-source project for running a small LLM and limited agent workflows on ESP32-P4 hardware, with model details, architecture notes, examples, and setup instructions.

A Python tool manager for AI agents that uses an LLM-tools.txt registry to install, pin, describe, and execute tools with one predictable contract.

A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code.

A local-first desktop environment for dispatching coding tasks to any model and any agent, with diff review, terminal streaming, task history, and per-project configuration.

An open-source ID library that generates human-readable, token-efficient IDs for AI agents and LLM workflows, with parsing, validation, deterministic IDs, and alias mapping utilities.

An experimental autonomous bare-metal OS agent that uses an LLM, VirtualBox, and screenshot inspection to iterate on low-level code, boot a VM, and refine behavior from execution results.

A TypeScript markdown parser built for incremental streaming, aimed at parsing LLM markdown output on the server or client. It exposes a typed AST, supports CommonMark and GFM tables, and includes examples for full and streaming parsing.

Apple Machine Learning Research paper proposing LaDiR, a reasoning framework that combines a VAE-based latent space with latent diffusion to improve LLM text reasoning and iterative refinement.

Search2o is a Python package for running searchable AI agents inside an organization, with a REST API, bundled GUI, and support for self-hosted or vendor LLMs.

A self-hosted CI system with an embedded runner that can generate pipelines through an LLM, with examples for Python, Go, Node.js, Ansible, Chef, and agent deployment workflows.

Public evaluation code for an Agent Memory Leaderboard, including answer-generation and scoring contracts for comparing LLM agent memory systems.

A write-up of a custom French-learning system built around spaced repetition, grammar tracking, and a voice practice app. It explains the problem, the workflow, and the model/API stack used to keep costs low.

arXiv paper on a self-speculative decoding framework for speeding up reasoning LLM inference on edge hardware, with hardware co-design and reported speedups.

A research preprint describing ADHD, a parallel divergent ideation method for LLM coding agents that isolates branches, uses cognitive frames, and then prunes with a separate critic pass.

A project writeup about turning a 1999 Big Mouth Billy Bass into an offline LLM-powered jokester using an ESP32, local LAN compute, and custom hardware/software design.

A prompt-based medieval fantasy text adventure for LLM chats, with character creation, combat, companions, inventory tracking, and a main quest to find four mysterious items.

A free browser arcade game where you play as an LLM, dodging prompt injections, hallucinations, rate limits, and deprecation while gobbling tokens.