# robots.txt for determined.ai — corrected by CrawlCheck, 2026-11-13 # Source: the file the site served at the time. Every change is listed here; nothing else was touched. # Changes: # - The served robots.txt was not answering 200 (526), so no crawler could read it. This is a minimal replacement that allows everything and names the sitemap; add your own Disallow lines to it. # Verify after publishing: curl -sI https://determined.ai/robots.txt must show text/plain, on the bare URL, with no cache-buster. User-agent: * Allow: /