URL
A resource identifier that also supplies a network location and access scheme.
What URL does not show
A syntactically valid URL may redirect, fail, or identify no durable entity.
How CrawlCheck measures URL
One finding code measures it. Its share of all scans is computed from the live corpus when this page is served, not typed into it.
| Finding code | Share of scans | Guide |
|---|---|---|
SITEMAP_URL_OFF_HOST | 0.1% | dataset |
Every code, its rule and its current rate: the dataset page. Scan a site to see which apply to it.
Where URL comes up on this site
- XML sitemap audit: check the file and every URL in itEvery listed URL resolves directly to 200 , is crawlable and indexable, and declares itself canonical.
- Canonical URL audit: do tags, redirects and sitemap agree?But a page reached through the site's own navigation, answering 200, whose canonical names a different URL, has told crawlers it is not the page to index.
- Staging site leak: how to find a staging URL in your live pages and close itA site is built or restored on the staging host, then pushed to production with a database replace of the staging URL for the live one.
- A placeholder check flagged NaN. It was inside a URLAll three were in one place: a sitemap excerpt, inside a live-blog URL slug like /QtNaNj2NkpSp/ .
- Is Cloudflare blocking AI crawlers on your site?Then compare identities on the bare URL, never with a cache-buster, because a crawler never appends one: curl -s -o /dev/null -w "%{http_code} %{size_download}\n" -A "Mozilla/5.0" https://yoursite.com/ curl -s -o /dev/null -w "%{http_code}…
Definitions that name URL
placeholder in record · own-host loop · triple · microformats (h-card) · case consistency · nonexistent-path control · user-triggered fetch · canonical · GPTBot vs OAI-SearchBot · IndexNow · faceted navigation · Crawl frontier · Recrawl interval · Sitemap URL set · Crawl demand · Deindexing
Related terms in Linked data and entities
The RDF and JSON-LD machinery behind structured data, and the schema.org types a business page actually needs.
SearchAction · Dataset (schema.org) · DataDownload · DataCatalog · variableMeasured · TechArticle · CollectionPage · DefinedTermSet · IRI · URI · Blank node · Literal · Datatype · Language tag · Predicate · Subject · Object · Named graph · Default graph · RDF dataset · Graph merge · Graph normalization · Canonical RDF · JSON-LD expansion · JSON-LD compaction · JSON-LD flattening · Remote context · Context poisoning · Vocabulary term · Schema type · Schema property · domainIncludes · rangeIncludes · Inverse property · ItemList · BreadcrumbList · WebPage · Article · NewsArticle · BlogPosting · Product · Offer · Service · Place · PostalAddress · GeoCoordinates · ContactPoint · AggregateRating · Review · Author relationship · Publisher relationship · mainEntity
Questions about URL
What is URL?
A resource identifier that also supplies a network location and access scheme.
What does URL not show or guarantee?
A syntactically valid URL may redirect, fail, or identify no durable entity.
How does CrawlCheck measure URL?
Through the finding code SITEMAP_URL_OFF_HOST, each with a stated rule, evidence bytes and a live share of scans on the dataset page.
Which area of the glossary does URL belong to?
Linked data and entities: The RDF and JSON-LD machinery behind structured data, and the schema.org types a business page actually needs.
← URI · Blank node →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.