Glossary · Crawlers and access
agent arrival
One request from a software agent recorded at the site that received it, with the agent it claimed, the path it asked for and whether the claim verified. Arrivals are reported by the site's own edge code or a log reporter, counted per day and per site, and never stored with the visitor's address.
What agent arrival means
One request from a software agent recorded at the site that received it, with the agent it claimed, the path it asked for and whether the claim verified. Arrivals are reported by the site's own edge code or a log reporter, counted per day and per site, and never stored with the visitor's address. It can show which agents actually visit and what they fetch; it cannot describe the open web from a handful of sites, so a published rate needs a floor of reporting sites behind it.
What agent arrival can and cannot support
| It can support | It cannot support |
|---|---|
| One request from a software agent recorded at the site that received it, with the agent it claimed, the path it asked for and whether the claim verified. | Arrivals are reported by the site's own edge code or a log reporter, counted per day and per site, and never stored with the visitor's address. It can show which agents actually visit and what they fetch; it cannot describe the open web from a handful of sites, so a published rate needs a floor of reporting sites behind it. |
Related terms in Crawlers and access
Who is fetching, whether they are who they claim, and what your rules actually permit.
visitor resolve · published crawler ranges · operator origin · signed agent · agent conduct record · agent traffic index · user-triggered fetch exemption · retrieval crawler · user-triggered fetch · verified crawler · forged crawler identity · unverifiable · robots.txt · user-agent group · AI opt-out · Content-Signal · crawl budget · cloaking · challenge page at 200 · uniform refusal · nonexistent-path control · blocked render resource · off-host redirect · homepage refused · FCrDNS · Crawler trap · Conditional request · ASN blocking · operator feed · residential proxy · Google-Extended · Google-Agent · GPTBot vs OAI-SearchBot · ClaudeBot vs Claude-User · PerplexityBot vs Perplexity-User · CCBot · Bytespider · agentic traffic · crawler classification · user agent · datacenter IP · vantage point · rate limit · delivery comparison · honeypot
Questions about agent arrival
What is agent arrival?
One request from a software agent recorded at the site that received it, with the agent it claimed, the path it asked for and whether the claim verified. Arrivals are reported by the site's own edge code or a log reporter, counted per day and per site, and never stored with the visitor's address.
What does agent arrival not show or guarantee?
Arrivals are reported by the site's own edge code or a log reporter, counted per day and per site, and never stored with the visitor's address. It can show which agents actually visit and what they fetch; it cannot describe the open web from a handful of sites, so a published rate needs a floor of reporting sites behind it.
Which area of the glossary does agent arrival belong to?
Crawlers and access: Who is fetching, whether they are who they claim, and what your rules actually permit.
← signed agent · agent conduct record →
See it in the full glossary · 688 terms across 19 areas.