Free check for your website

# Can AI *read your site?*

See what your website serves to AI crawler request profiles. CrawlCheck compares real responses from its own network, names what went wrong, and shows you what to fix first.
Domain
Check my site

**Free. No signup, nothing installed, nothing changed on your site.**

**The deepest free site audit there is.** 50 sections, read as 16 named crawler request profiles and 3 comparison controls, every finding named and the first one shown with its evidence.

Where scans come from →
[Example report · a public site, checked daily · 7 hours ago www.denverpost.com Grade C Score 81/100 Things to fix 11 AI assistants like ChatGPT can read this site, but find little they can quote from its pages. Fix firstrobots.txt rules do not apply to named agents See the full report →](/r/dd2fg28eos)
 Last scan finished **51 minutes ago** · **3** domains measured today

How it works

## See exactly what each request received.

We compare what your site serves to search crawlers, training crawlers, user-triggered fetchers and controls from CrawlCheck's network. That includes separate desktop and smartphone Googlebot requests. We also read your robots.txt, machine files and declared agent permissions. The answer is graded by published rules and signed, so anyone can check it offline.

#### The full definition

CrawlCheck is the verification layer for the agentic web. It measures what a site actually serves — tested with named crawler request profiles, including desktop and smartphone Googlebot, alongside its machine files, crawl policy, declared rights and capabilities — decides findings by published rules, and signs the answer so an agent can verify it offline before it reads, cites, connects or acts. Site owners get the same measurement as a free A–F audit with every defect named.

**Paying never changes a reading.** [The scan, step by step](/how-it-works) · [Live figures](/metrics)

Independent research

## Being readable beats being talked about.

In 37,927 AI agent sessions about 1,056 real businesses, agents did better on every measure when they could read the business’s own site.

| **1.9×** | as often clearly recommended |
| --- | --- |
| **78% vs 56%** | of answers built from the business’s own pages |
| **41%** | more accurate answers |
| **7–10%** | of the answer came from the model’s memory |

Source: Finder, Elovic, Shalev and Yosef, “AX is the New AEO”, [arXiv:2609.34951](https://arxiv.org/abs/2609.34951), 29 September 2026. CrawlCheck was not involved in the study.

Questions

## What people ask before they check.

#### Q Can ChatGPT read my website?

ChatGPT reaches the web through more than one crawler: OAI-SearchBot finds pages for ChatGPT search, and GPTBot collects content for model training. Allowing GPTBot is not needed to appear in ChatGPT search, and blocking it does not remove you. Many sites block one or both in robots.txt or behind a bot wall without knowing. That is the access we can test, not the only way an AI service may reach your content. The free check fetches your homepage as OAI-SearchBot, GPTBot and fourteen other crawlers from our own network and shows exactly what each one got.

#### Q Why doesn’t my business show up in AI answers?

Three usual reasons: the crawler is blocked, the page it gets has no readable text, or there is no clear fact to quote: a name, address, hours and prices that match everywhere. The report names which one applies to you.

#### Q Is the check free, and does it change anything on my site?

Free, no account. Every request is a read, the same GET a crawler makes. Nothing is installed, submitted or changed.

#### Q What does registering my site do?

It tells every agent that asks who runs the site and what it declares, verified by a fetch. Free, from the registry page.

Four doors

## Who it is for.

### [Agents](/for-agents)

One signed yes-or-no before your agent acts on a site.

[Quickstart](/docs/quickstart) · [Resolve](/spec/resolve) · [SDKs](/sdk)

### [Site owners](/for-sites)

Check free. We fix it for $100; Watch re-checks twice a day and alerts you if it regresses, from $29 a month.

Scan · [Fix](/pricing#fix) · [Watch](/pricing#trial)

### [Developers and vendors](/developers)

The API, typed SDKs, the specs and the signing keys.

[API](/docs/api) · [Specs](/spec/resolve) · [Keys](/keys)

### [Researchers and press](/data)

A daily census of the top 1,000 sites, published as open CC BY data that anyone can check.

[Census](/data#census) · [Conduct](/agents/conduct) · [Datasets](/datasets)

We read your site the way crawlers do, from our own network, and every report says exactly what was asked for and what came back. [Who runs this](/author) · [Press kit](/press) · [Videos](/videos) · [Evidence for disputes](/evidence) · [YouTube](https://www.youtube.com/@crawlcheck) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io)

#### How we measure, and our own machine files

CrawlCheck reads every site as itself. Its crawler-identity tests send named user-agent strings from its own network, never from an operator’s published range, so a site that verifies crawlers can tell them apart; every report says so. Results reflect what an anonymous non-browser client receives. [What we collect and how to opt out](/policy) · [how every report is timestamped](/proof) · [who runs this](/author) · [press kit](/press) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io).

**Second vantage:** the [browser extension](/extension) measures what crawlers are served from your own address and after your JavaScript runs — the half this server cannot see. From 1.0.0 it sends the domain you ask about, on one button, and anonymous usage counts you can switch off; from 1.0.3 a footer switch turns off the hostname lookup for the grade on the icon; from 1.0.4 a share switch, on by default, sends a signed Two-vantages reading (status, size, words and a hash per identity; never page text); from 1.0.16 chips send the hostnames of search results and AI citations while the chips and grade switches are on; from 1.0.17 a readings switch, on by default, sends one signed page reading a day (numbers, the hostname and the page address with the query removed; never in incognito; at most 40 a day) and only while the share and grade switches are also on. Earlier versions send nothing.

**Our own machine layer for the agentic web:** [llms.txt](/llms.txt) · [llms-full.txt](/llms-full.txt) · [agents.md](/agents.md) · [SKILL.md](/SKILL.md) · [entitymap.json](/entitymap.json) · [media kit](/.well-known/media-kit.json) · [MCP server card](/.well-known/mcp/server-card.json) · [API catalog](/.well-known/api-catalog) · [OpenAPI](/openapi.json) · [robots.txt](/robots.txt) · [sitemap.xml](/sitemap.xml) · [security.txt](/.well-known/security.txt) — every one named in robots.txt, which is exactly what we check for on yours. Home page updated 2026-11-09 .

**Pages:** [Keys](/keys) · [Listing check](/listing-check) · [Entity map validator](/entity-map-validator) · [SEO nap checker](/seo-nap-checker) · [Conduct: OAI-SearchBot](/agents/conduct/oai-searchbot) | **Registry:** [MCP](/registry/mcp) | **Datasets:** [Michigan](/datasets/state/michigan) · [Technologies: Onetrust](/datasets/technologies/onetrust) · [Problems: Broken embed](/datasets/problems/broken-embed) | **Blog:** [AI picked a local contractor 422 times: rating decided it](/blog/ai-picked-a-local-contractor-422-times-the-rating-decided-it) | **Glossary:** [entity map parity](/glossary/entity-map-parity) · [Layout-aware parsing](/glossary/layout-aware-parsing)

[Contact](/contact) · [Partnerships](/partnerships) · [Terms of service](/terms) · [Refund policy](/refunds) · [Trust center](/trust) · [Subprocessors](/subprocessors) · [Changelog](/changelog) · [Report an error](/report-error)