CrawlCheck

Registry

abcnews.go.com

Fetched 2026-10-29. Graded D, 63 of 100, 9 findings.

llms.txtagents.mdMedia kitEntity graphAI access policyAgent-callable

Is this your site? Claim this record — free, by DNS TXT or a meta tag.

Get these 9 findings fixed

Every defect this row counts, corrected on the site itself and then re-measured from the outside — done is measured, not asserted. One-time, $100 for one local-business site, thirty days of monitoring included.

Get this fixed — $100

What that covers

Claiming is free and changes nothing but the owner mark. What a licence adds is the record behind this entry: re-measured twice a day, finding age on every defect, change receipts between any two dates. Keep it on the daily record.

What the fetch found

FindingSeverity
The sitemap is refused4 of 5
The sitemap is refused4 of 5
robots.txt rules do not apply to named agents3 of 5
robots.txt rules name a retired crawler, not the one that visits3 of 5
The homepage sends crawlers to a different hostname3 of 5
Almost nothing a machine receives from this page is readable text3 of 5
The homepage is reached through a chain of redirects1 of 5
No llms.txt1 of 5
HTTPS is served without a Strict-Transport-Security header1 of 5

Section scores on this fetch

Weakest first. 6 of 21 scored sections at 90 or above.

SectionScore
Authorship and trust signals (E-E-A-T proxies)0
Payload and render path0
Sitemap coverage0
AI and search agents33
Image signals40
Quotable content50
Mobile surface50
Machine layer60
Schema and entity graph63
RDF and linked-data surface67
Accessibility structure (from the delivered HTML)70
Server and hosting75
Machine-file trust chain75
Naming and case consistency75
What each agent receives83
Crawl waste100
Speed a crawler sees, and field data where it exists100
Agent instruction surface100
Exposed files and secrets100
Error pages100
Internal linking100

Shelves

ShelfStateDefinition
llms.txtnot foundWhat counts, and who has it
agents.mdnot foundWhat counts, and who has it
Media kitnot foundWhat counts, and who has it
Entity graphnot foundWhat counts, and who has it
AI access policyon the shelfWhat counts, and who has it
Agent-callablenot foundWhat counts, and who has it

The full report for this fetch

Machine-readable: /api/registry?host=abcnews.go.com. This row states what was served to CrawlCheck at that time. It is not an endorsement, and it says nothing this scan did not measure.