CrawlCheck

Datasets · by problem

The ARD manifest is served only under its old name

The manifest is served only at /.well-known/ai-catalog.json or with rel="ai-catalog", the names ARD's predecessor used. Consulting those names is optional for consumers; a conformant consumer that reads only /.well-known/ard.json and rel="ard" does not find this site. 207 sites had this problem when we measured them in the last 7 days. The list gives each one with its domain, name where known, platform, every technology we detected, its A–F grade with all its findings, location where known, and what it serves AI crawlers.

  • 207 sites, measured in the last 7 days
  • 26 US local businesses
  • 2026-11-20 last counted, recounted every hour
  • $99 once, about 48¢ a row, 30 days of downloads

At a glance: 53% of these sites run Next.js, and the most common grade among them is C (61%). How CrawlCheck measures

Who has it

Platform

Next.js 53%No CMS detected 37%WordPress 7%Webflow 2%Squarespace 0%

Grade

C 61%A 22%D 7%B 7%F 3%

Where

SaaS and software 64%Wider corpus 21%US local businesses 13%Government and education 2%

WhereCategoryGradePlatformAI crawlers
SaaS and softwareSaasANo CMS detectedallowed
SaaS and softwareDocsCNext.jsallowed
SaaS and softwareSaasCNext.jsallowed
SaaS and softwareSaasDNext.jsallowed
SaaS and softwareSaasANext.jsallowed
Wider corpusOtherCNext.jsallowed
SaaS and softwareSaasCNo CMS detectedallowed
SaaS and softwareSaasBNo CMS detectedallowed

A sample from the live files. Names and websites are withheld here; they are in the file you buy. A business found with a defect is never named publicly before its owner has been contacted.

Every field: what a row holds · free sample of this list · a problem, country or industry we do not list: order a custom dataset.