CrawlCheck

Entity map

What this site declares itself to be

The human half of entitymap.json. Both are rendered from one record, so they cannot drift apart.

An entity map ships as a pair: JSON for machines, this page for people. The measurement worth making is not whether the pair exists but whether the two halves AGREE — every entity a machine can read here is one a reader can check, and the reverse.

CrawlCheck

Type
SoftwareApplication
Canonical URL
https://crawlcheck.io/
What it is
Fetches robots.txt, sitemaps and llms.txt from outside your network and reports what a non-browser client receives, including 200s that carry a challenge.

CrawlCheck machine-layer dataset

Type
Dataset
Canonical URL
https://crawlcheck.io/data
What it is
Aggregate counts of machine-layer defects observed across every scan. Published as counts only; no scanned domain is named.

Generated 2026-08-20T06:16:49.336Z · 2 entities · publisher CrawlCheck