forged crawler identity
A request whose user-agent names a known crawler while its source address falls outside the ranges that operator publishes.
What forged crawler identity does not show
Verified against a published feed it is a fact, not an accusation; without a feed it is unverifiable.
Where forged crawler identity comes up on this site
- Why a self-identifying crawler header must never clear a checkThe glossary defines verified crawler and forged crawler identity ; we counted our own users as forgers is the incident this header answers.
- How much AI crawler traffic is forged? Checked against IP rangesThe glossary defines verified crawler , forged crawler identity and forward-confirmed reverse DNS , the older check that the address feeds replace.
Terms this definition uses
Related terms in Crawlers and access
Who is fetching, whether they are who they claim, and what your rules actually permit.
visitor resolve · published crawler ranges · operator origin · signed agent · agent arrival · agent conduct record · agent traffic index · user-triggered fetch exemption · retrieval crawler · user-triggered fetch · verified crawler · unverifiable · robots.txt · user-agent group · AI opt-out · Content-Signal · crawl budget · cloaking · challenge page at 200 · uniform refusal · nonexistent-path control · blocked render resource · off-host redirect · homepage refused · FCrDNS · Crawler trap · Conditional request · ASN blocking · operator feed · residential proxy · Google-Extended · Google-Agent · GPTBot vs OAI-SearchBot · ClaudeBot vs Claude-User · PerplexityBot vs Perplexity-User · CCBot · Bytespider · agentic traffic · crawler classification · user agent · datacenter IP · vantage point · rate limit · delivery comparison · honeypot
Questions about forged crawler identity
What is forged crawler identity?
A request whose user-agent names a known crawler while its source address falls outside the ranges that operator publishes.
What does forged crawler identity not show or guarantee?
Verified against a published feed it is a fact, not an accusation; without a feed it is unverifiable.
Which area of the glossary does forged crawler identity belong to?
Crawlers and access: Who is fetching, whether they are who they claim, and what your rules actually permit.
← verified crawler · unverifiable →
See it in the full glossary · 731 terms across 19 areas.