# robots.txt for siteliner.com — corrected by CrawlCheck, 2026-09-03 # Source: the file the site served at the time. Every change is listed here; nothing else was touched. # Changes: # - The served robots.txt was HTML, not text, so no crawler could read it. This is a minimal replacement that allows everything and names the sitemap; add your own Disallow lines to it. # Verify after publishing: curl -sI https://siteliner.com/robots.txt must show text/plain, on the bare URL, with no cache-buster. User-agent: * Allow: /