[Glossary](/glossary) · [Indexing and discovery](/glossary/area/indexing-and-discovery)

# boilerplate

The text that appears on most pages of a site: navigation, footer, cookie notice, sidebar.

## What boilerplate does not show

It puts a floor under every duplicate-content comparison, so it must be removed before pages are compared, and it inflates a page's word count without adding anything an engine would quote.

## Where boilerplate comes up on this site

- [Do AI crawlers render JavaScript? Check what they see](/guides/do-ai-crawlers-render-javascript)If you get navigation and boilerplate while the substance is missing, the substance is assembled in the browser and does not exist for a client that does not run one.
- [Text-to-HTML ratio: does it matter, and how to check it](/guides/text-to-html-ratio-when-a-page-is-mostly-code)A parked domain with 800 words of boilerplate has an excellent ratio, as shown in a parking page that defeats every thin-content check .
- [Text extractors dropped our schema and still got us right](/blog/a-pipeline-threw-away-our-schema-and-got-us-right-anyway)It is not a bug in either: stripping boilerplate is what these services exist to do, and `<head>` is boilerplate by any reasonable definition.

## Definitions that name boilerplate

[token](/glossary/token) · [near-duplicate](/glossary/near-duplicate)

## Related terms in Indexing and discovery

Whether a page can be found and kept, separately from whether it can be fetched.

[nosnippet](/glossary/nosnippet) · [max-snippet](/glossary/max-snippet) · [max-image-preview](/glossary/max-image-preview) · [unavailable_after](/glossary/unavailable-after) · [noimageindex](/glossary/noimageindex) · [index coverage](/glossary/index-coverage) · [canonical](/glossary/canonical) · [noindex](/glossary/noindex) · [X-Robots-Tag](/glossary/x-robots-tag) · [orphan page](/glossary/orphan-page) · [E-E-A-T](/glossary/e-e-a-t) · [E-E-A-T proxies](/glossary/e-e-a-t-proxies) · [topical authority](/glossary/topical-authority) · [Soft 404](/glossary/soft-404) · [case consistency](/glossary/case-consistency) · [accessibility structure](/glossary/accessibility-structure) · [landmark region](/glossary/landmark-region) · [accessible name](/glossary/accessible-name) · [skip link](/glossary/skip-link) · [main landmark](/glossary/main-landmark) · [alt attribute](/glossary/alt-attribute) · [form control name](/glossary/form-control-name) · [duplicate id](/glossary/duplicate-id) · [IndexNow](/glossary/indexnow) · [faceted navigation](/glossary/faceted-navigation) · [thin content](/glossary/thin-content) · [duplicate content](/glossary/duplicate-content) · [near-duplicate](/glossary/near-duplicate) · [MinHash](/glossary/minhash) · [shingle](/glossary/shingle) · [dead anchor](/glossary/dead-anchor) · [placeholder content](/glossary/placeholder-content) · [image placeholder](/glossary/image-placeholder) · [alt text](/glossary/alt-text) · [EXIF](/glossary/exif)

## Questions about boilerplate

### What is boilerplate?

The text that appears on most pages of a site: navigation, footer, cookie notice, sidebar.

### What does boilerplate not show or guarantee?

It puts a floor under every duplicate-content comparison, so it must be removed before pages are compared, and it inflates a page's word count without adding anything an engine would quote.

### Which area of the glossary does boilerplate belong to?

Indexing and discovery: Whether a page can be found and kept, separately from whether it can be fetched.

← [near-duplicate](/glossary/near-duplicate) · [MinHash](/glossary/minhash) →

[See it in the full glossary](/glossary/boilerplate) · 792 terms across 19 areas.

Free browser extension

See this on any site you visit, **in one click.**

CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.

[Add to Chrome — free](https://chromewebstore.google.com/detail/plgjengobhbdmbgckiiaaflgiepdbcpi?utm_source=crawlcheck.io&utm_medium=glossary)
[What it does](/extension)

Written by

[Emmanuel Orta](/author) · VSNARY

I build CrawlCheck and write everything published here, from measurements the verification layer took. Where a post got something wrong, the correction stays in the post.

[Every post, and where I got it wrong →](/author) · [Follow on LinkedIn →](https://www.linkedin.com/in/emmanuelorta)

We read your site the way crawlers do, from our own network, and every report says exactly what was asked for and what came back. [Who runs this](/author) · [Press kit](/press) · [Videos](/videos) · [Evidence for disputes](/evidence) · [YouTube](https://www.youtube.com/@crawlcheck) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io)

#### How we measure, and our own machine files

CrawlCheck reads every site as itself. Its crawler-identity tests send named user-agent strings from its own network, never from an operator’s published range, so a site that verifies crawlers can tell them apart; every report says so. Results reflect what an anonymous non-browser client receives. [What we collect and how to opt out](/policy) · [how every report is timestamped](/proof) · [who runs this](/author) · [press kit](/press) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io).

**Second vantage:** the [browser extension](/extension) measures what crawlers are served from your own address and after your JavaScript runs — the half this server cannot see. From 1.0.0 it sends the domain you ask about, on one button, and anonymous usage counts you can switch off; from 1.0.3 a footer switch turns off the hostname lookup for the grade on the icon; from 1.0.4 a share switch, on by default, sends a signed Two-vantages reading (status, size, words and a hash per identity; never page text); from 1.0.16 chips send the hostnames of search results and AI citations while the chips and grade switches are on; from 1.0.17 a readings switch, on by default, sends one signed page reading a day (numbers, the hostname and the page address with the query removed; never in incognito; at most 40 a day) and only while the share and grade switches are also on. Earlier versions send nothing.

**Our own machine layer for the agentic web:** [llms.txt](/llms.txt) · [llms-full.txt](/llms-full.txt) · [agents.md](/agents.md) · [SKILL.md](/SKILL.md) · [entitymap.json](/entitymap.json) · [media kit](/.well-known/media-kit.json) · [MCP server card](/.well-known/mcp/server-card.json) · [API catalog](/.well-known/api-catalog) · [OpenAPI](/openapi.json) · [robots.txt](/robots.txt) · [sitemap.xml](/sitemap.xml) · [security.txt](/.well-known/security.txt) — every one named in robots.txt, which is exactly what we check for on yours.

**Pages:** [/](/) · [Listing check](/listing-check) · [SDK](/sdk) · [Certificates](/certificates) | **Glossary:** [agentic knowledge graph](/glossary/agentic-knowledge-graph) · [Sitemap URL set](/glossary/sitemap-url-set) · [Topic cluster](/glossary/topic-cluster) · [C2PA assertion](/glossary/c2pa-assertion) · [token audience](/glossary/token-audience) | **Directory:** [Deepcrawl](/directory/deepcrawl) | **Registry:** [botview.app](/registry/botview.app) · [dreamsoft4u.com](/registry/dreamsoft4u.com)

[Contact](/contact) · [Partnerships](/partnerships) · [Terms of service](/terms) · [Refund policy](/refunds) · [Trust center](/trust) · [Subprocessors](/subprocessors) · [Changelog](/changelog) · [Report an error](/report-error)
