# robots.txt for zilliz.com — corrected by CrawlCheck, 2026-11-03 # Source: the file the site served at the time. Every change is listed here; nothing else was touched. # Changes: # - 4 named groups lacked Disallow lines the * group carries. A crawler obeys only its own most specific group and ignores *, so those rules never applied to it. Copied in. # Verify after publishing: curl -sI https://zilliz.com/robots.txt must show text/plain, on the bare URL, with no cache-buster. # * User-agent: * Allow: * Disallow: /ty/* # GPTBot User-agent: GPTBot Allow: / Disallow: /ty/* # PerplexityBot User-agent: PerplexityBot Allow: / Disallow: /ty/* # ClaudeBot User-agent: ClaudeBot Allow: / Disallow: /ty/* # Amazonbot User-agent: Amazonbot Allow: / Disallow: /ty/* # Host Host: https://zilliz.com # Sitemaps Sitemap: https://zilliz.com/sitemap.xml