uniform refusal
An origin answering the homepage and a path that cannot exist the same way: same status, same size, or the same challenge or block page. A site does not serve a missing page identically to its home page, so the answers describe a wall rather than the site.
What uniform refusal does not show
CrawlCheck records exactly one finding for such a scan and grades nothing; a score produced through a wall would be a number about someone else's product.
How CrawlCheck measures uniform refusal
One finding code measures it. Its share of all scans is computed from the live corpus when this page is served, not typed into it.
| Finding code | Share of scans | Guide |
|---|---|---|
UNIFORM_REFUSAL | 11.9% | Free AI visibility checkers: how to tell if one is any good |
Every code, its rule and its current rate: the dataset page. Scan a site to see which apply to it.
Terms this definition uses
Definitions that name uniform refusal
graded through a wall · bot management platform
Related terms in Crawlers and access
Who is fetching, whether they are who they claim, and what your rules actually permit.
visitor resolve · published crawler ranges · operator origin · signed agent · agent arrival · agent conduct record · agent traffic index · user-triggered fetch exemption · retrieval crawler · user-triggered fetch · verified crawler · forged crawler identity · unverifiable · robots.txt · user-agent group · AI opt-out · Content-Signal · crawl budget · cloaking · challenge page at 200 · nonexistent-path control · blocked render resource · off-host redirect · homepage refused · FCrDNS · Crawler trap · Conditional request · ASN blocking · operator feed · residential proxy · Google-Extended · Google-Agent · GPTBot vs OAI-SearchBot · ClaudeBot vs Claude-User · PerplexityBot vs Perplexity-User · CCBot · Bytespider · agentic traffic · crawler classification · user agent · datacenter IP · vantage point · rate limit · delivery comparison · honeypot
Questions about uniform refusal
What is uniform refusal?
An origin answering the homepage and a path that cannot exist the same way: same status, same size, or the same challenge or block page. A site does not serve a missing page identically to its home page, so the answers describe a wall rather than the site.
What does uniform refusal not show or guarantee?
An origin answering the homepage and a path that cannot exist the same way: same status, same size, or the same challenge or block page. A site does not serve a missing page identically to its home page, so the answers describe a wall rather than the site. CrawlCheck records exactly one finding for such a scan and grades nothing; a score produced through a wall would be a number about someone else's product.
How does CrawlCheck measure uniform refusal?
Through the finding code UNIFORM_REFUSAL, each with a stated rule, evidence bytes and a live share of scans on the dataset page.
Which area of the glossary does uniform refusal belong to?
Crawlers and access: Who is fetching, whether they are who they claim, and what your rules actually permit.
← challenge page at 200 · nonexistent-path control →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.