# robots.txt for speechify.com — corrected by CrawlCheck, 2026-11-03 # Source: the file the site served at the time. Every change is listed here; nothing else was touched. # Changes: # - 2 named groups lacked Disallow lines the * group carries. A crawler obeys only its own most specific group and ignores *, so those rules never applied to it. Copied in. # Verify after publishing: curl -sI https://speechify.com/robots.txt must show text/plain, on the bare URL, with no cache-buster. User-Agent: * Allow: /onboarding/sign-in/ Disallow: /*?landing= Disallow: /api/ Disallow: /onboarding/ User-Agent: AdsBot-Google Disallow: /*?landing= Disallow: /api/ Disallow: /onboarding/ User-Agent: OAI-AdsBot Allow: / Disallow: /api/ Disallow: /*?landing= Disallow: /onboarding/ User-Agent: OAI-SearchBot User-Agent: ChatGPT-User User-Agent: GPTBot User-Agent: ClaudeBot User-Agent: Claude-User User-Agent: Claude-SearchBot User-Agent: PerplexityBot Allow: /onboarding/sign-in/ Disallow: /*?landing= Disallow: /*&landing= Disallow: /*_rsc= Disallow: /api/ Disallow: /onboarding/ Disallow: /*/onboarding/ Sitemap: https://speechify.com/sitemap_index.xml