CrawlCheck

Datasets · by problem

A staging hostname is exposed in the page source

A staging hostname appears in the page source. If that hostname is reachable and indexable it competes with the production site for the same content. 346 sites had this problem when we measured them in the last 7 days. The list gives each one with its domain, name where known, platform, every technology we detected, its A–F grade with all its findings, location where known, and what it serves AI crawlers.

  • 346 sites, last 7 days
  • 170 US local businesses
  • 1% also block an AI crawler
  • $99 once, 30 days of downloads

Who has it

Platform

WordPress 84%Drupal 11%No CMS detected 4%Next.js 1%

Grade

C 33%A 24%B 22%F 11%D 10%

Where

US local businesses 49%Wider corpus 32%Government and education 15%SaaS and software 4%

WhereCategoryGradePlatformAI crawlers
Government and educationGov EduCWordPressallowed
Tucson, ArizonaRestaurantAWordPressallowed
Scottsdale, ArizonaCafeAWordPressallowed
Government and educationGov EduCNext.jsallowed
Kirkland, WashingtonClinicAWordPressallowed
University Place, WashingtonGolf CourseBWordPressallowed
Edmonds, WashingtonSports HallCWordPressallowed
Seattle, WashingtonPrintingCWordPressallowed

A sample from the live files. Names and websites are withheld here; they are in the file you buy. A business found with a defect is never named publicly before its owner has been contacted.

Every field: what a row holds · 25 free rows · a problem, country or industry we do not list: order a custom dataset.