Duplicate cluster
URLs grouped because their content is judged substantially equivalent.
What Duplicate cluster does not show
Incorrect clustering can suppress a distinct page; the site cannot directly inspect every engine’s cluster.
Related terms in Crawling and indexing
How a crawler discovers, schedules, fetches and selects pages, and why a fetched page is not an indexed one.
Crawler identity · Product token · Identification string · Crawl frontier · Crawl queue · Crawl scheduler · Seed URL · URL discovery · Link extraction · Recrawl interval · Crawl frequency · Host politeness · Crawl rate · Crawl-delay · Robots group merging · Longest-match rule · Wildcard rule · End-anchor rule · Robots cache · Robots parse error · Robots redirect · Robots unavailable · Sitemap · Sitemap URL set · Sitemap lastmod · Sitemap hreflang · Image sitemap · Video sitemap · News sitemap · Canonical cluster · Index selection · Crawl demand · Rendering queue · Rendered HTML · Indexing pipeline · Index freshness · Index lag · Deindexing · Removal request · URL inspection · Crawl anomaly · Bot spoofing · Shared IP range · Web Bot Auth
Questions about Duplicate cluster
What is Duplicate cluster?
URLs grouped because their content is judged substantially equivalent.
What does Duplicate cluster not show or guarantee?
Incorrect clustering can suppress a distinct page; the site cannot directly inspect every engine’s cluster.
Which area of the glossary does Duplicate cluster belong to?
Crawling and indexing: How a crawler discovers, schedules, fetches and selects pages, and why a fetched page is not an indexed one.
← Canonical cluster · Index selection →
See it in the full glossary · 731 terms across 19 areas.