CrawlCheck

Datasets · by problem

The cache is still serving a file the origin no longer has

423 sites had this problem when we measured them in the last 7 days. The list gives each one with its domain, name where known, platform, every technology we detected, its A–F grade with all its findings, location where known, and what it serves AI crawlers.

  • 423 sites, last 7 days
  • 152 US local businesses
  • 4% also block an AI crawler
  • $99 once, 30 days of downloads

Who has it

Platform

No CMS detected 64%WordPress 25%Wix 4%Next.js 3%Drupal 2%Squarespace 1%

Grade

D 39%C 23%F 23%B 12%A 4%

Where

Wider corpus 49%US local businesses 36%Government and education 11%SaaS and software 4%

WhereCategoryGradePlatformAI crawlers
SaaS and softwareOtherDNo CMS detectedallowed
Government and educationGov EduCWordPressallowed
Glendale, ArizonaCoffeeDNo CMS detectedallowed
Wider corpusOtherCWordPressallowed
Government and educationGov EduDNo CMS detectedallowed
Ellensburg, WashingtonDoctorBWordPressallowed
Edmonds, WashingtonWater UtilityDWixallowed
WashingtonGardenDWixallowed

A sample from the live files. Names and websites are withheld here; they are in the file you buy. A business found with a defect is never named publicly before its owner has been contacted.

Every field: what a row holds · 25 free rows · a problem, country or industry we do not list: order a custom dataset.