CrawlCheck

Findings · 2026-09-25 · By · 0 views

CrawlCheck is crawlcheck.io, not crawlcheck.dev or .com

One CrawlCheck has been scanning sites and sealing the results to the Bitcoin blockchain since 13 August 2026. A second one appeared on 18 September under the same name. Here is the public record, how to tell us apart, and what each one actually does.

CrawlCheck is crawlcheck.io. Its domain was registered on 12 August 2026 and its reports have been sealed to the Bitcoin blockchain every day since 13 August. It is not affiliated with crawlcheck.dev, a separate product registered on 18 September 2026 that bills through Paddle or Lemon Squeezy, or with crawlcheck.com, a 2011 registration with no working site. Our only website is crawlcheck.io, our email is @crawlcheck.io, and we take payment only through Stripe.

There is one CrawlCheck, and it is crawlcheck.io. We are not affiliated with crawlcheck.dev, crawlcheck.com, or any other website, app, extension or account that uses the CrawlCheck name and is not linked from this site. We did not build them, we do not run them, we do not take their payments, and we will not answer for them.

One of them, crawlcheck.dev, sells an AI-crawler audit under our exact name, with a two-tone wordmark — “Crawl” in white, “Check” in teal, on a dark page — that is easy to mistake for ours. It appeared 37 days after we did. This page sets out the record, which is not ours to edit, and exactly what each site does.

The short version #

crawlcheck.dev does a fraction of what CrawlCheck does. Its free tools read a robots.txt you paste in, and its scanner fetches one page as 8 crawlers, three times a day. Its paid report sweeps up to 50 pages of one site as the same 8 crawlers and returns a fix list. CrawlCheck audits the whole site: 114 named crawlers resolved from robots.txt, 15 crawler identities sent to your site live, 35 measured sections with 24 of them scored, an open dataset from thousands of scans, reports anyone can prove were never altered, a browser extension, a documented API, and a team that will implement every fix it finds. It uses our name, and it arrived five weeks after we did.

The record #

Anyone can say they were first. The dates below come from three public records that neither site controls, so anyone can check them without trusting us.

12 Augcrawlcheck.io registered, first certificate13 Augfirst day anchored to Bitcoin — then every day since25 Septhis notice7 Augscanner ships37 days before a second CrawlCheck existed18 Sepcrawlcheck.dev registered, first certificate21 Sepits terms of service take effectCRAWLCHECK.IOCRAWLCHECK.DEV
Each tick on the line is a day on which crawlcheck.io’s reports were sealed and anchored to the Bitcoin blockchain. Dates from the registries’ RDAP records, public Certificate Transparency logs and our proof page.
Recordcrawlcheck.io (us)crawlcheck.devWho keeps it
Domain registered12 Aug 202618 Sep 2026The .io and .dev registries (RDAP)
First TLS certificate for the current site12 Aug 2026, 20:48 UTC18 Sep 2026, 12:04 UTCPublic Certificate Transparency logs
First day sealed to the Bitcoin blockchain13 Aug 2026, and every day sinceNoneThe Bitcoin blockchain, via OpenTimestamps
Terms of service in effectAt launch21 Sep 2026Each site’s own terms page

The third row is the one nobody can argue with. Every day since 13 August, a fingerprint of that day’s crawlcheck.io reports has been written into the Bitcoin blockchain. A timestamp there cannot be backdated by anyone — including us. The site was scanning real domains and sealing the results for 36 days before crawlcheck.dev’s domain was registered. The receipts are on our proof page, and any of them can be checked with free, open tools.

The name is older than both of us, and that is fine #

We checked further back, because a page like this should survive anyone checking it. The word has been used before, and none of those uses has anything to do with either site:

None of those were AI-crawler audits, and none of them are a problem. What changed on 18 September is different in kind: a second product in the same market, selling the same kind of audit, under the identical name, with a wordmark in the same two colours, five weeks after ours went live. That is the one we are writing about.

Every CrawlCheck domain we checked #

DomainWhat is there (25 Sep 2026)Ours?
crawlcheck.ioThis site: the AI-visibility audit, reports, research, API and browser extensionYes
crawlcheck.devA separate product under the same name: registered 18 Sep 2026, paid report billed through Paddle or Lemon Squeezy, contact hi@crawlcheck.devNo
crawlcheck.comRegistered in 2011 by someone else; no working website answered when we checkedNo
.net, .org, .ai, .app, .co, .tech, .xyz, .pro, .tools, .me, .so, .cloud, .page, .store, .shop, .site, .online, .us, .info, .bizNot registered, or no website, when we checkedNo
Any other CrawlCheck app, extension, social account or siteNot ours unless crawlcheck.io links to itNo

How to tell it is us #

What each one does #

crawlcheck.dev’s column is taken from its own pages — home, scanner, about, terms and refund policy — read on 25 September 2026, and it includes the paid report its terms describe. Ours is measured on this site the same day.

crawlcheck.io (us)crawlcheck.dev (not us)
What you give itA domain. We fetch the live site ourselves.A robots.txt you paste in, or one page URL for its free scanner (3 scans a day)
Crawlers covered114 named crawler agents resolved from robots.txt; 15 crawler identities sent to your site live“60+” AI crawlers in its list, built from the open ai.robots.txt community project; its scanner and paid report fetch as 8
What is measured35 measured sections, 24 of them scored: robots.txt and its hidden rule conflicts, machine files, structured data and the entity graph, local listings, speed and morerobots.txt verdicts, a live fetch per crawler, a bot-versus-browser text check, JSON-LD, llms.txt, noindex and readable text, rolled into one score
Paid reportThe fix list implemented on your site for $749 with 30 days of monitoring, or Watch monitoring (/pricing)“Pro Deep Report”: up to 50 pages of one site, 8 crawlers, a prioritized fix list at a private URL, 30-day money-back guarantee; price shown only at checkout
Proof of resultsEvery report fingerprinted with SHA-256; each day anchored to Bitcoin (how it works)Not offered on its site
Open dataPublished dataset from 2,394 scans across 6,992 measured sites (/data)Not offered on its site
Research65 published findings, 26 guides and a 579-term glossaryGuides and a crawler directory
Free toolsPer-crawler robots.txt reader, llms.txt drafter, access-log crawler verifier, sitemap, HSTS and EntityMap startersrobots.txt auditor and generator; FAQ, HowTo and Article schema generator
Browser extensionYes: measures what crawlers are served from your own browser (/extension)Not offered on its site
API21 documented endpoints, 14 open, plus an MCP server (/docs/api)Not documented on its site; its scanner runs on api.crawlcheck.dev
Who implements the fixesWe do, on your site, and prove each one with a re-scanNot offered on its site; the report is a list for you to work through
PaymentsStripePaddle or Lemon Squeezy
Contacthello@crawlcheck.iohi@crawlcheck.dev

The gap is not a matter of taste. A robots.txt verdict tells you what a file says. A live fetch as 8 crawlers tells you what 8 crawlers were served on the pages you asked about. CrawlCheck does both, for 15 crawler identities and every section of the site that answer engines read, then publishes the evidence, seals it, and fixes what it finds. That is what the name stood for five weeks before anyone else used it.

We are watching, and we keep receipts #

Our monitoring checks every hour for new domains close to our name — whether each one resolves, holds a TLS certificate, or serves a page — and keeps watching crawlcheck.dev and crawlcheck.com for changes. Each hit is checked by hand before anything is said about it, because a similar name is often a coincidence. When something matters, it is recorded with its date and the evidence behind it, the same way we record everything else. If anything changes — a new lookalike, a changed wordmark, a site that stops using the name — this page will say so, with the date.

To whoever runs crawlcheck.dev #

You launched an AI-crawler audit under a name that a live AI-crawler audit had already been using for five weeks, with a wordmark in the same two colours. The dates are in public logs that neither of us can change. We have no interest in your customers and will not contact them. Pick a name of your own, and we will note it on this page the day you do. Until then, this page stays up and stays accurate.

If something claiming to be CrawlCheck contacted you #

If an email, invoice, extension or account says it is CrawlCheck and it is not on crawlcheck.io or from an @crawlcheck.io address, it is not us. Forward it to hello@crawlcheck.io and we will look at it. If you bought a report through Paddle or Lemon Squeezy, that purchase was with crawlcheck.dev; its terms offer a 30-day money-back guarantee through hi@crawlcheck.dev.

Method #

Registration dates come from each registry’s RDAP record: crawlcheck.io (Identity Digital, registrar Namecheap), crawlcheck.dev (registrar Cloudflare) and crawlcheck.com (registrar GoDaddy). Certificate dates are the earliest entries for each current site in public Certificate Transparency logs, read through crt.sh. Seal dates are listed on our proof page with their OpenTimestamps files. The GitHub project’s dates are its first and last commits. The other domains were checked by DNS lookup and an HTTPS request on 25 September 2026. crawlcheck.dev’s features, processors, guarantee and contact address are quoted from its own pages the same day. This page describes the sites as we found them; it makes no claim about who runs crawlcheck.dev.

Every figure above came out of this scanner.

Point it at your own domain and see the same measurements, free.

Scan a domain — free

The main product

Found this on your own site? We fix it for $749.

Scan free to see where you stand. The fix is one site, every finding implemented and re-measured, with a sealed before and after.

Questions this post answers

Is crawlcheck.dev the same company as crawlcheck.io?

No. crawlcheck.dev is a separate product with its own terms, payment processors and contact address. We have no connection to it.

Which CrawlCheck came first?

crawlcheck.io. Its domain and first certificate date from 12 August 2026 and its reports have been sealed to Bitcoin daily since 13 August. crawlcheck.dev's domain and first certificate date from 18 September 2026.

Did crawlcheck.io copy crawlcheck.dev?

No. crawlcheck.io was live, scanning and publishing for 37 days before crawlcheck.dev's domain was registered, and public registry, certificate and blockchain records show it.

Is crawlcheck.com yours?

No. It was registered in 2011 by someone else and had no working website when we checked on 25 September 2026.

How do I know I am on the real CrawlCheck?

The address is crawlcheck.io, email comes from @crawlcheck.io, and payment is only through Stripe links on crawlcheck.io.

I was charged by Paddle or Lemon Squeezy for a CrawlCheck report. Is that you?

No. We only use Stripe. crawlcheck.dev's terms name Paddle and Lemon Squeezy as its merchants of record and offer refunds through hi@crawlcheck.dev.

Related findings

How anything measured in this article was measured15client identitiesone second, one address5machine filesapex and www114named agentsresolved from robots.txt24sections scoredreach, read, quoteHow anything measured here was measured15 client identities5 machine files114 named agents24 sections scoredone second, one addressapex and wwwresolved from robots.txtreach, read, quote
No account, nothing installed, and the same sequence on every domain — which is what makes one scan comparable to another. Run it on your own site.

Comments

Comments are read before they appear. Nothing is published automatically, and no account is needed.

Writing about this? Facts, live figures and marks — every number on that page is dated and traceable to a scan.

All findings · The dataset · How the dataset works