# robots.txt for jasper.ai — corrected by CrawlCheck, 2026-11-03
# Source: the file the site served at the time. Every change is listed here; nothing else was touched.
# Changes:
#   - Read from https://www.jasper.ai/robots.txt (the apex redirected there); publish at the host you serve.
#   - 6 named groups lacked Disallow lines the * group carries. A crawler obeys only its own most specific group and ignores *, so those rules never applied to it. Copied in.
# Verify after publishing: curl -sI https://jasper.ai/robots.txt must show text/plain, on the bare URL, with no cache-buster.

User-agent: Googlebot
User-agent: Bingbot
User-agent: Slurp
Allow: /
Disallow: /credits-rate-card

User-agent: PerplexityBot
User-agent: YouBot
User-agent: Applebot-Extended
User-agent: Google-Extended
Allow: /
Disallow: /credits-rate-card

User-agent: anthropic-ai
User-agent: ClaudeBot
Allow: /
Disallow: /credits-rate-card

User-agent: GPTBot
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
Allow: /
Disallow: /credits-rate-card

User-agent: CCBot
User-agent: cohere-ai
User-agent: AI2Bot
User-agent: Diffbot
User-agent: Bytespider
User-agent: meta-externalagent
User-agent: FacebookBot
Allow: /
Disallow: /credits-rate-card

User-agent: Omgilibot
Disallow: /
Disallow: /credits-rate-card

User-agent: *
Disallow: /credits-rate-card

Content-Signal: ai-train=yes, search=yes, ai-input=yes

Sitemap: https://www.jasper.ai/sitemap.xml