[Glossary](/glossary) · [HTTP, edge and rendering](/glossary/area/http-edge-and-rendering)

# edge cache

A copy of a response stored at a CDN's point of presence and served to later requests for the same key without consulting the origin.

## What edge cache does not show

It is keyed on the URL, so a request with an unfamiliar query string usually misses it; the copy can outlive a deleted path, a changed file or an origin that has started refusing, and nothing about the bare URL reveals which.

## How CrawlCheck measures edge cache

3 finding codes measure it. Each one’s share of all scans is computed from the live corpus when this page is served, not typed into it.

| Finding code | Share of scans | Guide |
| --- | --- | --- |
| `STALE_CACHE_SERVED` | 13.4% | [Is Cloudflare blocking AI crawlers on your site?](/guides/is-cloudflare-blocking-ai-crawlers-on-your-site) |
| `ORIGIN_BLOCKED_BEHIND_CACHE` | 0.2% | [Is Cloudflare blocking AI crawlers on your site?](/guides/is-cloudflare-blocking-ai-crawlers-on-your-site) |
| `MACHINE_FILE_CACHE_STALE` | 0.4% | [Does llms.txt work? What is known and how to test it](/guides/does-llms-txt-actually-work) |

Every code, its rule and its current rate: [the dataset page](/data). [Scan a site](/) to see which apply to it.

## Where edge cache comes up on this site

- [Stale cached robots.txt or llms.txt? Two fetches tell you](/guides/machine-file-caching-stale-split-and-blocked-behind-the-edge)GET /robots.txt bare, as a crawler asks GET /robots.txt?cc=x7k2p cache-busted Edge cache stored copy answers Edge cache key misses, passes on Origin the file as it is now Compare status, type, bytes If the two answers differ, the edge and the origin…
- [Is your host blocking ClaudeBot? Group the 403s by IP first](/blog/we-almost-published-that-our-host-was-blocking-claude)Those were fixed by putting the machine files behind an edge cache, so the high-frequency endpoints stop touching the origin at all.
- [robots.txt returns 200 but no crawler can read it](/blog/a-file-that-answered-200-and-could-not-be-read)The damage came from an edge cache rule written to make machine files fast.

## Related terms in HTTP, edge and rendering

The delivery layer between an origin and a client: proxies, caches, redirects, status codes and the headers that decide what a crawler actually received.

[Content-Language header](/glossary/content-language) · [HTTP/3](/glossary/http-3) · [Alt-Svc](/glossary/alt-svc) · [HTTPS DNS record](/glossary/https-dns-record) · [Link header](/glossary/link-header) · [content negotiation](/glossary/content-negotiation) · [Markdown negotiation](/glossary/markdown-negotiation) · [Retry-After](/glossary/retry-after) · [Server-Timing](/glossary/server-timing) · [WWW-Authenticate](/glossary/www-authenticate) · [Allow header](/glossary/allow-header) · [Content-Digest](/glossary/content-digest) · [Origin server](/glossary/origin-server) · [Reverse proxy](/glossary/reverse-proxy) · [CDN](/glossary/cdn) · [Edge node](/glossary/edge-node) · [WAF](/glossary/waf) · [Bot score](/glossary/bot-score) · [TLS handshake](/glossary/tls-handshake) · [DNS resolution](/glossary/dns-resolution) · [DNS timeout](/glossary/dns-timeout) · [Connection timeout](/glossary/connection-timeout) · [Read timeout](/glossary/read-timeout) · [Redirect chain](/glossary/redirect-chain) · [Redirect loop](/glossary/redirect-loop) · [301 redirect](/glossary/301-redirect) · [302 redirect](/glossary/302-redirect) · [307 redirect](/glossary/307-redirect) · [308 redirect](/glossary/308-redirect) · [304 response](/glossary/304-response) · [404 response](/glossary/404-response) · [410 response](/glossary/410-response) · [429 response](/glossary/429-response) · [500 response](/glossary/500-response) · [502 response](/glossary/502-response) · [503 response](/glossary/503-response) · [504 response](/glossary/504-response) · [HEAD request](/glossary/head-request) · [GET request](/glossary/get-request) · [Content type](/glossary/content-type) · [MIME sniffing](/glossary/mime-sniffing) · [Content encoding](/glossary/content-encoding) · [Compression](/glossary/compression) · [Brotli](/glossary/brotli) · [ETag](/glossary/etag) · [Last-Modified](/glossary/last-modified) · [If-None-Match](/glossary/if-none-match) · [Cache hit](/glossary/cache-hit) · [Cache miss](/glossary/cache-miss) · [Cache key](/glossary/cache-key) · [Vary header](/glossary/vary-header) · [Stale response](/glossary/stale-response) · [Stale-while-revalidate](/glossary/stale-while-revalidate) · [Edge redirect](/glossary/edge-redirect) · [Origin bypass](/glossary/origin-bypass) · [Response parity](/glossary/response-parity) · [Header parity](/glossary/header-parity) · [hreflang](/glossary/hreflang) · [canonical URL](/glossary/canonical-url) · [HSTS](/glossary/hsts) · [HSTS preload list](/glossary/hsts-preload-list) · [Content-Security-Policy](/glossary/content-security-policy) · [CSP nonce](/glossary/csp-nonce) · [cache split](/glossary/cache-split) · [cache-buster](/glossary/cache-buster) · [Cache-Control](/glossary/cache-control) · [Age header](/glossary/age-header) · [render-blocking resource](/glossary/render-blocking-resource) · [payload text share](/glossary/payload-text-share) · [lazy loading](/glossary/lazy-loading) · [404 and 410 status codes](/glossary/404-and-410-status-codes)

## Questions about edge cache

### What is edge cache?

A copy of a response stored at a CDN's point of presence and served to later requests for the same key without consulting the origin.

### What does edge cache not show or guarantee?

A copy of a response stored at a CDN's point of presence and served to later requests for the same key without consulting the origin. It is keyed on the URL, so a request with an unfamiliar query string usually misses it; the copy can outlive a deleted path, a changed file or an origin that has started refusing, and nothing about the bare URL reveals which.

### How does CrawlCheck measure edge cache?

Through the finding codes STALE_CACHE_SERVED, ORIGIN_BLOCKED_BEHIND_CACHE, MACHINE_FILE_CACHE_STALE, each with a stated rule, evidence bytes and a live share of scans on the dataset page.

### Which area of the glossary does edge cache belong to?

HTTP, edge and rendering: The delivery layer between an origin and a client: proxies, caches, redirects, status codes and the headers that decide what a crawler actually received.

← [CSP nonce](/glossary/csp-nonce) · [cache split](/glossary/cache-split) →

[See it in the full glossary](/glossary/edge-cache) · 792 terms across 19 areas.

Free browser extension

See this on any site you visit, **in one click.**

CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.

[Add to Chrome — free](https://chromewebstore.google.com/detail/plgjengobhbdmbgckiiaaflgiepdbcpi?utm_source=crawlcheck.io&utm_medium=glossary)
[What it does](/extension)

Written by

[Emmanuel Orta](/author) · VSNARY

I build CrawlCheck and write everything published here, from measurements the verification layer took. Where a post got something wrong, the correction stays in the post.

[Every post, and where I got it wrong →](/author) · [Follow on LinkedIn →](https://www.linkedin.com/in/emmanuelorta)

We read your site the way crawlers do, from our own network, and every report says exactly what was asked for and what came back. [Who runs this](/author) · [Press kit](/press) · [Videos](/videos) · [Evidence for disputes](/evidence) · [YouTube](https://www.youtube.com/@crawlcheck) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io)

#### How we measure, and our own machine files

CrawlCheck reads every site as itself. Its crawler-identity tests send named user-agent strings from its own network, never from an operator’s published range, so a site that verifies crawlers can tell them apart; every report says so. Results reflect what an anonymous non-browser client receives. [What we collect and how to opt out](/policy) · [how every report is timestamped](/proof) · [who runs this](/author) · [press kit](/press) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io).

**Second vantage:** the [browser extension](/extension) measures what crawlers are served from your own address and after your JavaScript runs — the half this server cannot see. From 1.0.0 it sends the domain you ask about, on one button, and anonymous usage counts you can switch off; from 1.0.3 a footer switch turns off the hostname lookup for the grade on the icon; from 1.0.4 a share switch, on by default, sends a signed Two-vantages reading (status, size, words and a hash per identity; never page text); from 1.0.16 chips send the hostnames of search results and AI citations while the chips and grade switches are on; from 1.0.17 a readings switch, on by default, sends one signed page reading a day (numbers, the hostname and the page address with the query removed; never in incognito; at most 40 a day) and only while the share and grade switches are also on. Earlier versions send nothing.

**Our own machine layer for the agentic web:** [llms.txt](/llms.txt) · [llms-full.txt](/llms-full.txt) · [agents.md](/agents.md) · [SKILL.md](/SKILL.md) · [entitymap.json](/entitymap.json) · [media kit](/.well-known/media-kit.json) · [MCP server card](/.well-known/mcp/server-card.json) · [API catalog](/.well-known/api-catalog) · [OpenAPI](/openapi.json) · [robots.txt](/robots.txt) · [sitemap.xml](/sitemap.xml) · [security.txt](/.well-known/security.txt) — every one named in robots.txt, which is exactly what we check for on yours.

**Registry:** [MCP: Operator](/registry/mcp/operator) · [MCP](/registry/mcp) · [AI policy](/registry/aipolicy) | **Pages:** [IP ranges](/data/ip-ranges) | **Datasets:** [Technologies: Tailwind CSS](/datasets/technologies/tailwind-css) · [Problems: LLMs link broken](/datasets/problems/llms-link-broken) | **Blog:** [AI agents cannot refuse what they cannot see: 27 traps](/blog/ai-agents-cannot-refuse-what-they-cannot-see) | **AI crawlers:** [Blexbot](/ai-crawlers/blexbot) | **Glossary:** [AI classifiers: Temporal analysis](/glossary/ai-classifiers/temporal-analysis) · [Corpus](/glossary/corpus) · [DNS timeout](/glossary/dns-timeout) · [Broken link](/glossary/broken-link)

[Contact](/contact) · [Partnerships](/partnerships) · [Terms of service](/terms) · [Refund policy](/refunds) · [Trust center](/trust) · [Subprocessors](/subprocessors) · [Changelog](/changelog) · [Report an error](/report-error)
