AgentDish directory

distributed-inference

Accepted listings with this tag.

Listing Category Score Trend Checked

A GitHub repository for a 7-node ESP32-S3 cluster that runs a small LLM using 1.58-bit BitNet-style quantization over an SPI daisy-chain.

Developer Tools / AI / Machine Learning 82 ↓ -2 39 days ago Details
#2002 ↓ -1
Lumabri

Lumabri is an open-source distributed inference tool that runs large AI models across multiple computers and servers. It includes a terminal UI and browser interface, with setup, networking, memory budgeting, and calibration details documented in the README.

Developer Tools / Code Assistant 80 ↓ -1 15 days ago Details