AgentDish directory
web-crawler
Accepted listings with this tag.
| Listing | Category | Score | Trend | Checked | |
|---|---|---|---|---|---|
#476
↑ +2
doc-scraper
A Go-based crawler for scraping documentation sites into clean Markdown and JSONL for LLM ingestion, RAG pipelines, and offline searchable doc corpora. |
Developer Tool / AI Data Preparation | 86 | ↑ +2 | 3 days ago | Details |