CrawlCheck

Registry

food.com

Fetched 2026-10-10. Graded D, 65 of 100, 10 findings.

llms.txtagents.mdMedia kitEntity graphAI access policyAgent-callable

Is this your site? Claim this record — free, by DNS TXT or a meta tag.

Get these 10 findings fixed

Every defect this row counts, corrected on the site itself and then re-measured from the outside — done is measured, not asserted. One-time, $500 for one local-business site, thirty days of monitoring included.

Get this fixed — $500

What that covers

Claiming is free and changes nothing but the owner mark. What a licence adds is the record behind this entry: re-measured twice a day, finding age on every defect, change receipts between any two dates. Keep it on the daily record.

What the fetch found

FindingSeverity
The sitemap is refused4 of 5
robots.txt rules do not apply to named agents3 of 5
Almost nothing a machine receives from this page is readable text3 of 5
An answer engine's crawler was refused while a browser was served (seen once, not yet reproduced)2 of 5
The sitemap does not say when anything changed2 of 5
A sitemap answers 200 and lists nothing2 of 5
Ads take too much of the page on a phone2 of 5
No llms.txt1 of 5
HTTPS is served without a Strict-Transport-Security header1 of 5
A missing agent file answers with a full page1 of 5

Section scores on this fetch

Weakest first. 5 of 18 scored sections at 90 or above.

SectionScore
Authorship and trust signals (E-E-A-T proxies)0
AI and search agents33
Payload and render path40
Crawl waste50
What each agent receives50
Sitemap coverage50
Internal linking50
Schema and entity graph57
Machine layer60
Image signals60
Server and hosting80
Naming and case consistency80
Speed a crawler sees, and field data where it exists89
Accessibility structure (from the delivered HTML)95
RDF and linked-data surface100
Machine-file trust chain100
Agent instruction surface100
Mobile surface100

Shelves

ShelfStateDefinition
llms.txtnot foundWhat counts, and who has it
agents.mdnot foundWhat counts, and who has it
Media kitnot foundWhat counts, and who has it
Entity graphnot foundWhat counts, and who has it
AI access policyon the shelfWhat counts, and who has it
Agent-callablenot foundWhat counts, and who has it

The full report for this fetch

Machine-readable: /api/registry?host=food.com. This row states what was served to CrawlCheck at that time. It is not an endorsement, and it says nothing this scan did not measure.