CrawlCheck

Registry

forbes.com

Fetched 2026-10-12. Graded C, 77 of 100, 7 findings.

llms.txtagents.mdMedia kitEntity graphAI access policyAgent-callable

Is this your site? Claim this record — free, by DNS TXT or a meta tag.

Get these 7 findings fixed

Every defect this row counts, corrected on the site itself and then re-measured from the outside — done is measured, not asserted. One-time, $500 for one local-business site, thirty days of monitoring included.

Get this fixed — $500

What that covers

Claiming is free and changes nothing but the owner mark. What a licence adds is the record behind this entry: re-measured twice a day, finding age on every defect, change receipts between any two dates. Keep it on the daily record.

What the fetch found

FindingSeverity
robots.txt rules do not apply to named agents3 of 5
Almost nothing a machine receives from this page is readable text3 of 5
An answer engine's crawler was refused while a browser was served (unconfirmed from this vantage)2 of 5
The homepage is reached through a chain of redirects1 of 5
No llms.txt1 of 5
A missing agent file answers with a full page1 of 5
A business record gives an address but no coordinates1 of 5

Section scores on this fetch

Weakest first. 9 of 21 scored sections at 90 or above.

SectionScore
Payload and render path20
AI and search agents33
What each agent receives38
Machine layer40
Schema and entity graph67
Speed a crawler sees, and field data where it exists67
Authorship and trust signals (E-E-A-T proxies)71
Server and hosting75
Claim consistency75
Entity corroboration80
Sitemap coverage80
Naming and case consistency80
Accessibility structure (from the delivered HTML)91
RDF and linked-data surface100
Crawl waste100
Page subject, the Webref question100
Machine-file trust chain100
Agent instruction surface100
Mobile surface100
Internal linking100
Image signals100

Shelves

ShelfStateDefinition
llms.txtnot foundWhat counts, and who has it
agents.mdnot foundWhat counts, and who has it
Media kitnot foundWhat counts, and who has it
Entity graphon the shelfWhat counts, and who has it
AI access policyon the shelfWhat counts, and who has it
Agent-callablenot foundWhat counts, and who has it

The full report for this fetch

Machine-readable: /api/registry?host=forbes.com. This row states what was served to CrawlCheck at that time. It is not an endorsement, and it says nothing this scan did not measure.