User-agent: * Allow: / Disallow: /r/ # Agent instructions: https://crawlcheck.io/agents.md # Content map: https://crawlcheck.io/llms.txt # Entity graph: https://crawlcheck.io/entitymap.json # Data policy and opt-out: https://crawlcheck.io/policy Sitemap: https://crawlcheck.io/sitemap.xml Llms: https://crawlcheck.io/llms.txt EntityMap: https://crawlcheck.io/entitymap.json