Glossary · Indexing and discovery
boilerplate
The text that appears on most pages of a site: navigation, footer, cookie notice, sidebar.
What boilerplate means
The text that appears on most pages of a site: navigation, footer, cookie notice, sidebar. It puts a floor under every duplicate-content comparison, so it must be removed before pages are compared, and it inflates a page's word count without adding anything an engine would quote.
What boilerplate can and cannot support
| It can support | It cannot support |
|---|---|
| The text that appears on most pages of a site: navigation, footer, cookie notice, sidebar. | It puts a floor under every duplicate-content comparison, so it must be removed before pages are compared, and it inflates a page's word count without adding anything an engine would quote. |
Where boilerplate comes up on this site
- Do AI crawlers render JavaScript?If what comes back is navigation and boilerplate while the substance is missing, that substance is being assembled in the browser and does not exist for a client that does not run one.
- LLMs ignored our schema and still identified us: what actually got readIt is not a bug in either product — it is what boilerplate stripping means, and <head> is boilerplate by every reasonable definition.
- agents.md template inheritance: is the file on your domain yours?So we do not keep a hand-written list of platform boilerplate — that would rot the week a platform edits its template.
- llms.txt adoption rate: how many sites actually publish oneText-extraction pipelines that sit between a website and a model routinely discard the whole of <head> as boilerplate — which is where nearly all structured data is published, because that is where the documentation puts it.
Definitions that name boilerplate
Related terms in Indexing and discovery
Whether a page can be found and kept, separately from whether it can be fetched.
index coverage · canonical · noindex · X-Robots-Tag · orphan page · E-E-A-T · E-E-A-T proxies · topical authority · Soft 404 · case consistency · accessibility structure · landmark region · accessible name · skip link · main landmark · alt attribute · form control name · duplicate id · IndexNow · faceted navigation · thin content · duplicate content · near-duplicate · MinHash · shingle · dead anchor · placeholder content · image placeholder · alt text · EXIF
Questions about boilerplate
What is boilerplate?
The text that appears on most pages of a site: navigation, footer, cookie notice, sidebar.
What does boilerplate not show or guarantee?
It puts a floor under every duplicate-content comparison, so it must be removed before pages are compared, and it inflates a page's word count without adding anything an engine would quote.
Which area of the glossary does boilerplate belong to?
Indexing and discovery: Whether a page can be found and kept, separately from whether it can be fetched.
← near-duplicate · MinHash →
See it in the full glossary · 668 terms across 19 areas.