Glossary · Crawlers and access
agent traffic index
A monthly, signed edition of which software agents visited the sites that report their arrivals, how many sites each reached, how many fetches it made, how many were verified, forged or unverifiable, and what share went to machine files rather than pages. An agent appears with counts only once enough sites saw it, and no site is ever named.
What agent traffic index means
A monthly, signed edition of which software agents visited the sites that report their arrivals, how many sites each reached, how many fetches it made, how many were verified, forged or unverifiable, and what share went to machine files rather than pages. An agent appears with counts only once enough sites saw it, and no site is ever named. It can show the shape of agent traffic across a population of real sites; it cannot measure sites that do not report, so the reporting population is published with every edition.
Terms this definition uses
Related terms in Crawlers and access
Who is fetching, whether they are who they claim, and what your rules actually permit.
visitor resolve · published crawler ranges · operator origin · signed agent · agent arrival · agent conduct record · user-triggered fetch exemption · retrieval crawler · user-triggered fetch · verified crawler · forged crawler identity · unverifiable · robots.txt · user-agent group · AI opt-out · Content-Signal · crawl budget · cloaking · challenge page at 200 · uniform refusal · nonexistent-path control · blocked render resource · off-host redirect · homepage refused · FCrDNS · Crawler trap · Conditional request · ASN blocking · operator feed · residential proxy · Google-Extended · Google-Agent · GPTBot vs OAI-SearchBot · ClaudeBot vs Claude-User · PerplexityBot vs Perplexity-User · CCBot · Bytespider · agentic traffic · crawler classification · user agent · datacenter IP · vantage point · rate limit · delivery comparison · honeypot
Questions about agent traffic index
What is agent traffic index?
A monthly, signed edition of which software agents visited the sites that report their arrivals, how many sites each reached, how many fetches it made, how many were verified, forged or unverifiable, and what share went to machine files rather than pages. An agent appears with counts only once enough sites saw it, and no site is ever named.
What does agent traffic index not show or guarantee?
A monthly, signed edition of which software agents visited the sites that report their arrivals, how many sites each reached, how many fetches it made, how many were verified, forged or unverifiable, and what share went to machine files rather than pages. An agent appears with counts only once enough sites saw it, and no site is ever named. It can show the shape of agent traffic across a population of real sites; it cannot measure sites that do not report, so the reporting population is published with every edition.
Which area of the glossary does agent traffic index belong to?
Crawlers and access: Who is fetching, whether they are who they claim, and what your rules actually permit.
← agent conduct record · user-triggered fetch exemption →
See it in the full glossary · 688 terms across 19 areas.