# robots.txt for heygen.com — corrected by CrawlCheck, 2026-11-03 # Source: the file the site served at the time. Every change is listed here; nothing else was touched. # Changes: # - Read from https://www.heygen.com/robots.txt (the apex redirected there); publish at the host you serve. # - 29 named groups lacked Disallow lines the * group carries. A crawler obeys only its own most specific group and ignores *, so those rules never applied to it. Copied in. # Verify after publishing: curl -sI https://heygen.com/robots.txt must show text/plain, on the bare URL, with no cache-buster. User-agent: * Disallow: /ebook/register Disallow: /app2/tr User-agent: Googlebot User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Googlebot-News User-agent: Bingbot User-agent: DuckDuckBot User-agent: DuckAssistBot User-agent: Baiduspider User-agent: YandexBot User-agent: Sogou User-agent: YouBot User-agent: PetalBot Disallow: /ebook/register Disallow: /app2/ Disallow: /metrics? Disallow: /app2/tr User-agent: Yeti User-agent: NaverBot User-agent: Daum Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Google-Extended Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Google-Agent Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: GPTBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: OAI-SearchBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: ChatGPT-User Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: OAI-Operator Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: ClaudeBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Claude-Web Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Claude-SearchBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Claude-Code Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Claude-User Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: PerplexityBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Perplexity-User Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Gemini-Fetch Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Gemini-Deep-Research Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Applebot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Applebot-Extended Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Amazonbot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: FacebookBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: Facebot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: meta-webindexer Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: meta-externalfetcher Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: meta-externalagent Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: AhrefsBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: AhrefsSiteAudit Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: CCBot Allow: / Disallow: /ebook/register Disallow: /app2/tr User-agent: NeevaBot User-agent: PhindBot User-agent: PoeBot User-agent: AndiBot User-agent: komo-crawler Disallow: / Disallow: /ebook/register Disallow: /app2/tr Sitemap: https://www.heygen.com/sitemap.xml Sitemap: https://www.heygen.com/sitemap-blogs.xml Sitemap: https://www.heygen.com/sitemap-pt-br.xml Sitemap: https://www.heygen.com/sitemap-es-es.xml Sitemap: https://www.heygen.com/sitemap-id-id.xml Sitemap: https://www.heygen.com/sitemap-fr-fr.xml Sitemap: https://www.heygen.com/sitemap-de-de.xml Sitemap: https://www.heygen.com/sitemap-ko-kr.xml Sitemap: https://www.heygen.com/sitemap-it-it.xml Sitemap: https://www.heygen.com/sitemap-vi-vn.xml Sitemap: https://www.heygen.com/sitemap-nl-nl.xml Sitemap: https://www.heygen.com/sitemap-ja-jp.xml Sitemap: https://www.heygen.com/sitemap-tl-ph.xml Sitemap: https://www.heygen.com/sitemap-pl-pl.xml Sitemap: https://www.heygen.com/sitemap-en-gb.xml Sitemap: https://www.heygen.com/sitemap-en-in.xml Sitemap: https://www.heygen.com/sitemap-ur-pk.xml Sitemap: https://www.heygen.com/sitemap-es-mx.xml Sitemap: https://www.heygen.com/sitemap-ar-sa.xml Sitemap: https://www.heygen.com/sitemap-tr-tr.xml Sitemap: https://www.heygen.com/sitemap-he-il.xml Sitemap: https://www.heygen.com/sitemap-uk-ua.xml Sitemap: https://www.heygen.com/sitemap-en-ca.xml Sitemap: https://www.heygen.com/sitemap-ar-eg.xml Sitemap: https://www.heygen.com/sitemap-th-th.xml Sitemap: https://www.heygen.com/sitemap-sv-se.xml Sitemap: https://www.heygen.com/sitemap-es-ar.xml Sitemap: https://www.heygen.com/sitemap-es-co.xml Sitemap: https://www.heygen.com/sitemap-zh-tw.xml Sitemap: https://www.heygen.com/sitemap-zh-hk.xml