URL inspection
A diagnostic view of an engine’s known state for one URL.
What URL inspection does not show
It is a sampled product report, not a complete history of all crawler and index decisions.
Terms this definition uses
Related terms in Crawling and indexing
How a crawler discovers, schedules, fetches and selects pages, and why a fetched page is not an indexed one.
Crawler identity · Product token · Identification string · Crawl frontier · Crawl queue · Crawl scheduler · Seed URL · URL discovery · Link extraction · Recrawl interval · Crawl frequency · Host politeness · Crawl rate · Crawl-delay · Robots group merging · Longest-match rule · Wildcard rule · End-anchor rule · Robots cache · Robots parse error · Robots redirect · Robots unavailable · Sitemap · Sitemap URL set · Sitemap lastmod · Sitemap hreflang · Image sitemap · Video sitemap · News sitemap · Canonical cluster · Duplicate cluster · Index selection · Crawl demand · Rendering queue · Rendered HTML · Indexing pipeline · Index freshness · Index lag · Deindexing · Removal request · Crawl anomaly · Bot spoofing · Shared IP range · Web Bot Auth
Questions about URL inspection
What is URL inspection?
A diagnostic view of an engine’s known state for one URL.
What does URL inspection not show or guarantee?
It is a sampled product report, not a complete history of all crawler and index decisions.
Which area of the glossary does URL inspection belong to?
Crawling and indexing: How a crawler discovers, schedules, fetches and selects pages, and why a fetched page is not an indexed one.
← Removal request · Crawl anomaly →
See it in the full glossary · 731 terms across 19 areas.