Glossary · HTTP, edge and rendering
payload text share
The share of a delivered page's bytes that are visible text once markup, scripts, styles and inline data are removed. A page under about ten percent text is mostly code: a reader of the bytes, which is what a crawler is, has to work through nine parts machinery for one part content.
What payload text share means
The share of a delivered page's bytes that are visible text once markup, scripts, styles and inline data are removed. A page under about ten percent text is mostly code: a reader of the bytes, which is what a crawler is, has to work through nine parts machinery for one part content. It is a ratio, so a long page with heavy tooling can still read low.
How CrawlCheck measures payload text share
One finding code in the scanner read this. The share of all scans carrying each is computed from the live corpus when this page is served, not typed into it.
| Finding code | Share of scans | Guide |
|---|---|---|
PAGE_IS_MOSTLY_CODE | 22.5% | How to check whether AI crawlers can read your site |
Every code, its rule and its current rate: the dataset page. Scan a site to see which apply to it.
Related terms in HTTP, edge and rendering
The delivery layer between an origin and a client: proxies, caches, redirects, status codes and the headers that decide what a crawler actually received.
Origin server · Reverse proxy · CDN · Edge node · WAF · Bot score · TLS handshake · DNS resolution · DNS timeout · Connection timeout · Read timeout · Redirect chain · Redirect loop · 301 redirect · 302 redirect · 307 redirect · 308 redirect · 304 response · 404 response · 410 response · 429 response · 500 response · 502 response · 503 response · 504 response · HEAD request · GET request · Content type · MIME sniffing · Content encoding · Compression · Brotli · ETag · Last-Modified · If-None-Match · Cache hit · Cache miss · Cache key · Vary header · Stale response · Stale-while-revalidate · Edge redirect · Origin bypass · Response parity · Header parity · hreflang · canonical URL · HSTS · HSTS preload list · Content-Security-Policy · CSP nonce · edge cache · cache split · cache-buster · Cache-Control · Age header · render-blocking resource · lazy loading · 404 and 410 status codes
Questions about payload text share
What is payload text share?
The share of a delivered page's bytes that are visible text once markup, scripts, styles and inline data are removed. A page under about ten percent text is mostly code: a reader of the bytes, which is what a crawler is, has to work through nine parts machinery for one part content.
How does CrawlCheck measure payload text share?
Through the finding code PAGE_IS_MOSTLY_CODE, each with a stated rule, evidence bytes and a live share of scans on the dataset page.
Which area of the glossary does payload text share belong to?
HTTP, edge and rendering: The delivery layer between an origin and a client: proxies, caches, redirects, status codes and the headers that decide what a crawler actually received.
← render-blocking resource · lazy loading →
See it in the full glossary · 668 terms across 19 areas.