Octocrawl

Octocrawl: readable Markdown and checked fields from public web pages, for AI agents, RAG and research. Failures come back with a reason. Self-host with REST, SDK or MCP.

GitHub

Official source

Start locally with the CLI guide