Directory
SEO and AI-visibility tools, measured on their own sites
In one sentence
The CrawlCheck directory runs the same scan on each SEO and AI-visibility vendor’s own homepage that a customer gets — reach, read, quote, the grade and the findings — for 25 tools across AI visibility monitoring, content and GEO, enterprise SEO, SEO suites and site crawlers, re-measured roughly one vendor per hour with a dated ledger of what changed, exported as CSV and JSON under CC BY. Nothing is self-reported and no vendor is listed or removed for payment.
Every tool listed here sells some judgement about other people’s websites. This page runs the same scan on each vendor’s own homepage that a customer gets: can a named crawler reach it, can a machine read what it got, is there a fact it can quote. Nothing is self-reported.
25
tools listed
23
measured and graded
77
median score
11/23
publish llms.txt
0/23
publish an entity map
Re-measured on a rolling cadence, roughly one vendor per hour, so every card is under a day old. Index last rebuilt 2026-09-11 04:18 UTC. Highest today: Sitebulb at 85.
Refused this scanner — not graded
Refused this scanner — not graded
No vendor in this category yet.
Table view — every row, for copying or comparing
| Tool | Category (ours) | Grade · score | Reach · read · quote | Findings | Last scanned | |
|---|---|---|---|---|---|---|
| Sitebulb sitebulb.com | Site crawler | A | 85 | 100 · 76 · 74 | 2 | 2026-09-10 evidence |
| Rankscale rankscale.ai | AI visibility monitoring | C | 84 | 95 · 69 · 85 | 2 | 2026-09-10 evidence |
| Moz moz.com | SEO suite | C | 82 | 96 · 63 · 82 | 4 | 2026-09-10 evidence |
| Lumar lumar.io | Site crawler | B | 81 | 96 · 57 · 85 | 1 | 2026-09-10 evidence |
| Semrush semrush.com | SEO suite | C | 80 | 89 · 69 · 78 | 3 | 2026-09-10 evidence |
| Athena athenahq.ai | AI visibility monitoring | B | 80 | 100 · 76 · 56 | 1 | 2026-09-10 evidence |
| Goodie higoodie.com | AI visibility monitoring | C | 80 | 89 · 68 · 81 | 3 | 2026-09-11 evidence |
| Writesonic writesonic.com | Content and GEO | C | 80 | 92 · 68 · 76 | 2 | 2026-09-11 evidence |
| Surfer surferseo.com | Content and GEO | C | 79 | 92 · 55 · 87 | 4 | 2026-09-11 evidence |
| Ahrefs ahrefs.com | SEO suite | C | 78 | 94 · 62 · 72 | 5 | 2026-09-10 evidence |
| Botify botify.com | Site crawler | C | 78 | 92 · 63 · 75 | 4 | 2026-09-10 evidence |
| SE Ranking seranking.com | SEO suite | C | 77 | 96 · 57 · 73 | 5 | 2026-09-10 evidence |
| Screaming Frog screamingfrog.co.uk | Site crawler | C | 76 | 90 · 48 · 84 | 5 | 2026-09-10 evidence |
| Frase frase.io | Content and GEO | C | 75 | 93 · 62 · 63 | 2 | 2026-09-11 evidence |
| Oncrawl oncrawl.com | Site crawler | B | 74 | 80 · 76 · 63 | 2 | 2026-09-10 evidence |
| Seobility seobility.net | Site crawler | C | 74 | 76 · 68 · 76 | 6 | 2026-09-10 evidence |
| Similarweb similarweb.com | SEO suite | C | 73 | 84 · 56 · 75 | 2 | 2026-09-10 evidence |
| Peec AI peec.ai | AI visibility monitoring | C | 68 | 100 · 57 · 35 | 4 | 2026-09-10 evidence |
| Conductor conductor.com | Enterprise SEO | C | 67 | 84 · 49 · 63 | 6 | 2026-09-10 evidence |
| BrightEdge brightedge.com | Enterprise SEO | C | 66 | 85 · 56 · 51 | 0 | 2026-09-10 evidence |
| Profound tryprofound.com | AI visibility monitoring | C | 66 | 100 · 50 · 35 | 2 | 2026-09-10 evidence |
| Clearscope clearscope.io | Content and GEO | D | 62 | 83 · 55 · 40 | 3 | 2026-09-11 evidence |
| Siteliner siteliner.com | Site crawler | F | 44 | 44 · 29 · 60 | 9 | 2026-09-10 evidence |
| Otterly otterly.ai | AI visibility monitoring | refused this scanner — not graded | 2026-09-10 evidence | |||
| Scrunch scrunch.ai | AI visibility monitoring | refused this scanner — not graded | 2026-09-10 evidence | |||
Take the data: CSV · JSON, with the report URL behind every score, under CC BY 4.0. Cite it as “CrawlCheck directory, retrieved <date>” — every row regenerates, so a link always shows today’s state.
What changed, across every vendor
Every vendor here has been measured since 14 August, so a change between two readings is a dated fact. A finding code means the same thing before and after a change to our rubric, so appeared, resolved and returned are always shown; a score movement is only published when both readings ran under the same score version.
- 2026-09-10Athena a stale edge copy was served againreturned
- 2026-09-10Conductor a new finding appeared: NAP_NAME_DRIFT againreturned
- 2026-09-10Conductor a new finding appeared: NAP_UNDECLARED_LISTING againreturned
- 2026-09-10Conductor a stale edge copy was served againreturned
- 2026-09-10Screaming Frog a stale edge copy was served againreturned
- 2026-09-10Ahrefs no llms.txt was found againreturned
- 2026-09-10Ahrefs the homepage read as mostly markup againreturned
- 2026-09-10Ahrefs a render resource was blocked to crawlers againreturned
- 2026-09-10Ahrefs robots.txt no longer named a sitemap againreturned
- 2026-09-10Ahrefs a stale edge copy was served againreturned
- 2026-09-10Ahrefs resolved: this origin refused the scanner, so the site was never measuredresolved
- 2026-09-09Athena the stale edge copy clearedresolved
- 2026-09-09Conductor resolved: NAP_NAME_DRIFTresolved
- 2026-09-09Conductor resolved: NAP_UNDECLARED_LISTINGresolved
- 2026-09-09Screaming Frog the stale edge copy clearedresolved
- 2026-09-08Conductor the stale edge copy clearedresolved
- 2026-09-08Seobility an answer engine was refused againreturned
- 2026-09-08Seobility score moved 80 → 77score-down
- 2026-09-08Oncrawl a new finding appeared: https is served without a strict-transport-security headerappeared
- 2026-09-08Botify a stale edge copy was served againreturned
- 2026-09-08Botify score moved 82 → 81score-down
- 2026-09-08Sitebulb a new finding appeared: https is served without a strict-transport-security headerappeared
- 2026-09-08Screaming Frog score moved 75 → 76score-up
- 2026-09-08Similarweb score moved 75 → 74score-down
- 2026-09-08SE Ranking score moved 77 → 76score-down
- 2026-09-08Moz score moved 85 → 83score-down
- 2026-09-08Frase score moved 82 → 83score-up
- 2026-09-08Clearscope score moved 73 → 72score-down
- 2026-09-08Surfer a stale edge copy was served againreturned
- 2026-09-07Goodie score moved 83 → 82score-down
- 2026-09-07Rankscale score moved 86 → 85score-down
- 2026-09-07Athena a stale edge copy was servedappeared
- 2026-09-07Profound score moved 72 → 73score-up
- 2026-09-07Similarweb score moved 74 → 75score-up
- 2026-09-07SE Ranking score moved 76 → 77score-up
- 2026-09-07Moz score moved 83 → 85score-up
- 2026-09-06Peec AI score moved 73 → 72score-down
- 2026-09-06BrightEdge score moved 73 → 72score-down
- 2026-09-06Seobility score moved 81 → 80score-down
- 2026-09-06Screaming Frog score moved 76 → 75score-down
This is the one thing a single scan can never produce. A tool that starts measuring the day you ask it can tell you what is true now; only a record kept beforehand can tell you what moved. The same ledger runs on any domain under Watch.
How to read it
The score
The same AI visibility score every report on this site uses, under the current score version: reach (was a named crawler served the page), read (is it mostly text and are the machine files parseable), quote (is there a declared, consistent fact), in that order.
What moves it, and what cannot
Only the measurement. No vendor is listed for payment, no listing is removed for payment, and no score is edited on request — the same rule that governs every report here. A vendor who believes a reading is wrong gets a re-scan, published as measured.
Refused and opted out
A vendor that refused this scanner is listed without a grade: a refusal is a fact about our datacentre address, not a defect of the site. A vendor that opts out in robots.txt is listed as opted out, unmeasured, and can reverse it in the same file.
Categories and prices
Categories are ours. They describe what each product is primarily sold as, not what it can do, and they are not scored. Pricing is not listed, because a price we did not measure is a claim we cannot stand behind.
Why this page exists
Every directory of these tools we could find ranks them by self-reported features and affiliate fit, and none turns its own instrument on the vendors it recommends. We scanned 33 of them once and found a 92-to-41 spread and no entity maps. This page is that finding kept alive, in a form that can be quoted and checked.