refusal
An engine declining to answer.
What refusal does not show
A refusal is not evidence about your site: it is evidence about the engine policy at that moment, and treating it as a site defect inverts cause and effect.
How CrawlCheck measures refusal
4 finding codes measure it. Each one’s share of all scans is computed from the live corpus when this page is served, not typed into it.
| Finding code | Share of scans | Guide |
|---|---|---|
ANSWER_ENGINE_REFUSED | 6.2% | Is Cloudflare blocking AI crawlers on your site? |
ORIGIN_REFUSED_SCANNER | 0.2% | dataset |
HOMEPAGE_REFUSED | 1.4% | How to block AI crawlers like GPTBot and ClaudeBot |
UNIFORM_REFUSAL | 11.9% | Free AI visibility checkers: how to tell if one is any good |
Every code, its rule and its current rate: the dataset page. Scan a site to see which apply to it.
Where refusal comes up on this site
- One 503 is not a blocked site: refusal or hiccup?That is a cold origin waking up, not a refusal.
- Is Cloudflare blocking AI crawlers on your site?The refusal happens to a different client, from a different address, and produces no error anyone on your team sees.
- How to check if AI crawlers can read your siteA refusal like that, where robots.txt allows an answer engine and the edge turns it away, appears on of scans.
- How to rank in ChatGPT: the part that is in your controlThe refusal was at the edge.
- Free AI visibility checkers: how to tell if one is any goodWithout that, a refusal at the edge is invisible.
Definitions that name refusal
homepage refused · sitemap origin error · graded through a wall · rate limiting · bot management platform · Direct prompt injection · action assurance · broken embed
Related terms in Answer engines and retrieval
How a generated answer gets made, and what your page is competing for inside it.
AEO · GEO · AI visibility score · share of voice · prompt set · brand mention · RAG · grounding · training data · embedding · chunking · context window · token · hallucination · AI Overview · answer engine · citation · retrieval · hallucinated attribution · Hybrid search · Re-ranking · Passage ranking · Query fan-out · Chunk boundary · BM25 · cross-encoder · AI Mode · information gain · dense retrieval
Questions about refusal
What is refusal?
An engine declining to answer.
What does refusal not show or guarantee?
A refusal is not evidence about your site: it is evidence about the engine policy at that moment, and treating it as a site defect inverts cause and effect.
How does CrawlCheck measure refusal?
Through the finding codes ANSWER_ENGINE_REFUSED, ORIGIN_REFUSED_SCANNER, HOMEPAGE_REFUSED, UNIFORM_REFUSAL, each with a stated rule, evidence bytes and a live share of scans on the dataset page.
Which area of the glossary does refusal belong to?
Answer engines and retrieval: How a generated answer gets made, and what your page is competing for inside it.
← hallucination · AI Overview →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.