AI Developer Tool / Reinforcement Learning for LLMs

nanoRL

An open-source reinforcement learning training loop for LLMs, spanning small CPU-friendly experiments like CartPole to async RLVR runs on GPU clusters. The repo highlights a compact codebase, quickstart commands, task customization, and support for algorithms like REINFORCE, PPO, GRPO, and RLOO.

Clear25/30
Useful28/30
Specific17/20
Complete16/20
nanoRL screenshot

Why it was accepted

The page clearly describes an AI-focused developer tool with enough detail for a public listing: purpose, supported algorithms, quickstart commands, task layout, async training flow, and concrete hardware examples. It also shows real implementation evidence in the repository structure, tests, and documented workflow.

Weakness

The snapshot does not show deeper API docs, pretrained checkpoints, release tags, or broader adoption signals. It also does not let a visitor tell how much setup is needed beyond the listed commands or how polished the code is outside the documented examples.

Review status

86 days ago #726 ↑ +2

Last evaluated 86 days ago. Current rank #726. Up 2 spots in the rankings.

Score history

86

Related listings

Sidefleet screenshot
#38 Sidefleet
90

AI Developer Tool / Coding Agents / Orchestration

Sidefleet is a self-hosted control plane for running coding agents across your own machines. It routes tasks to the least busy machine with the right repo and agent, runs work in isolated git worktrees, streams progress live, and supports Claude Code, Codex, and opencode.

prompt-scrub screenshot
90

AI Developer Tool / Prompt privacy / PII redaction

A local-first Node.js utility that redacts emails, phone numbers, paths, secrets, URLs, and other identifiers from LLM prompts, then rehydrates responses locally using session-based mappings.

Tessary screenshot
#127 Tessary
89

AI Developer Tool / Agent reliability / observability

Open-source platform for monitoring AI agents in production, detecting failures, grouping incidents into cases, and investigating root causes with trace and repository evidence.

ORBIT screenshot
#177 ORBIT
89

AI Developer Tool / AI Gateway / RAG Backend

Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents. It connects files, databases, vector stores, APIs, and MCP tools through one backend with auth, observability, and governance features.