gpu

AutoGPU is an open-source project for using AI agents to design and harden a GPU-like chip end to end, from Verilog through synthesis and place-and-route to GDSII. The repo shows a concrete fp8 matmul accelerator flow, quick-start steps, and documentation for running the design/hardening process.

An open-source handbook for production LLM serving and inference at scale, covering GPU fundamentals, KV cache, batching, quantization, speculative decoding, and engines like vLLM, SGLang, and TensorRT-LLM.

Open-source AI infrastructure project focused on GPU memory management and serving, with a Python control plane, C++ data plane, and optional CUDA kernels.