CrawlCheck
Glossary · Crawlers and access

honeypot

A field, link or path that no human visitor would use, placed so that automated clients reveal themselves by touching it. On a form it catches bots without a challenge the visitor sees; on a site it can catch crawlers that ignore robots.txt.

What honeypot does not show

It identifies behaviour, not intent, and a real crawler that follows every link will trip a link honeypot too.

Terms this definition uses

Place · robots.txt

Related terms in Crawlers and access

Who is fetching, whether they are who they claim, and what your rules actually permit.

visitor resolve · published crawler ranges · operator origin · signed agent · agent arrival · agent conduct record · agent traffic index · user-triggered fetch exemption · retrieval crawler · user-triggered fetch · verified crawler · forged crawler identity · unverifiable · robots.txt · user-agent group · AI opt-out · Content-Signal · crawl budget · cloaking · challenge page at 200 · uniform refusal · nonexistent-path control · blocked render resource · off-host redirect · homepage refused · FCrDNS · Crawler trap · Conditional request · ASN blocking · operator feed · residential proxy · Google-Extended · Google-Agent · GPTBot vs OAI-SearchBot · ClaudeBot vs Claude-User · PerplexityBot vs Perplexity-User · CCBot · Bytespider · agentic traffic · crawler classification · user agent · datacenter IP · vantage point · rate limit · delivery comparison

Questions about honeypot

What is honeypot?

A field, link or path that no human visitor would use, placed so that automated clients reveal themselves by touching it. On a form it catches bots without a challenge the visitor sees; on a site it can catch crawlers that ignore robots.txt.

What does honeypot not show or guarantee?

On a form it catches bots without a challenge the visitor sees; on a site it can catch crawlers that ignore robots.txt. It identifies behaviour, not intent, and a real crawler that follows every link will trip a link honeypot too.

Which area of the glossary does honeypot belong to?

Crawlers and access: Who is fetching, whether they are who they claim, and what your rules actually permit.

← delivery comparison

See it in the full glossary · 792 terms across 19 areas.

Free browser extension

See this on any site you visit, in one click.

CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.