Some pages can only be reached by a click handler, not a link
Search and AI crawlers follow <a href> links. They do not click. A page that is reached only through a data-href attribute or an onclick that changes the address is, to a crawler, not linked at all: it is found only if the sitemap lists it, and it receives none of the link signals that tell a search engine or an AI system how important it is. This is the commonest way a site builds part of the “invisible web” by accident: product tiles, listing cards and menus wired in JavaScript. Only internal targets with no plain link anywhere on the pages read are counted, so a scripted card that duplicates a real link is not reported. 234 sites had this problem when we measured them in the last 7 days. The list gives each one with its domain, name where known, platform, every technology we detected, its A–F grade with all its findings, location where known, and what it serves AI crawlers.
- 234 sites, last 7 days
- 69 US local businesses
- 9% also block an AI crawler
- $99 once, 30 days of downloads
Who has it
Platform
No CMS detected 71%Squarespace 14%WordPress 8%Drupal 3%Next.js 3%Webflow 0%
Grade
D 35%C 32%A 18%B 12%F 3%
Where
Wider corpus 44%US local businesses 29%SaaS and software 21%Government and education 5%
| Where | Category | Grade | Platform | AI crawlers |
|---|---|---|---|---|
| SaaS and software | Other | A | No CMS detected | allowed |
| Government and education | Gov Edu | A | Drupal | allowed |
| Nottingham, Maryland | Insurance | C | Squarespace | allowed |
| Windsor Mill, Maryland | Restaurant | D | No CMS detected | allowed |
| Maryland | Place Of Worship | A | Squarespace | allowed |
| Chesapeake Beach, Maryland | Restaurant | A | WordPress | allowed |
| Salisbury, Maryland | Architect | B | WordPress | allowed |
| SaaS and software | Other | A | No CMS detected | allowed |
A sample from the live files. Names and websites are withheld here; they are in the file you buy. A business found with a defect is never named publicly before its owner has been contacted.
Every field: what a row holds · 25 free rows · a problem, country or industry we do not list: order a custom dataset.