unavailable_after
A robots directive that gives a date after which a page should no longer appear in search results, for example on an offer or an event page. CrawlCheck reads the date on each crawled page and flags it when the date has already passed on a page that is still meant to be found.
What unavailable_after does not show
It is a request to search engines; it does not remove, redirect or expire the page itself.
Where unavailable_after comes up on this site
- Meta robots vs X-Robots-Tag vs robots.txt: which one controls indexingLayer 2: meta robots and X-Robots-Tag are about the fetched page Both carry the same directives, noindex , nofollow , nosnippet , noimageindex , max-snippet , unavailable_after , and a crawler applies whichever it finds.
Terms this definition uses
Related terms in Indexing and discovery
Whether a page can be found and kept, separately from whether it can be fetched.
nosnippet · max-snippet · max-image-preview · noimageindex · index coverage · canonical · noindex · X-Robots-Tag · orphan page · E-E-A-T · E-E-A-T proxies · topical authority · Soft 404 · case consistency · accessibility structure · landmark region · accessible name · skip link · main landmark · alt attribute · form control name · duplicate id · IndexNow · faceted navigation · thin content · duplicate content · near-duplicate · boilerplate · MinHash · shingle · dead anchor · placeholder content · image placeholder · alt text · EXIF
Questions about unavailable_after
What is unavailable_after?
A robots directive that gives a date after which a page should no longer appear in search results, for example on an offer or an event page. CrawlCheck reads the date on each crawled page and flags it when the date has already passed on a page that is still meant to be found.
What does unavailable_after not show or guarantee?
It is a request to search engines; it does not remove, redirect or expire the page itself.
Which area of the glossary does unavailable_after belong to?
Indexing and discovery: Whether a page can be found and kept, separately from whether it can be fetched.
← max-image-preview · noimageindex →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.