B
Reach100Read76Quote70
2 findings · worst info✗ llms.txt✗ entity map
Directory
SEO and AI-visibility tools, measured on their own sites
In one sentence
The CrawlCheck directory runs the same scan on each SEO and AI-visibility vendor’s own homepage that a customer gets — reach, read, quote, the grade and the findings — for 25 tools across AI visibility monitoring, content and GEO, enterprise SEO, SEO suites and site crawlers, re-measured roughly one vendor per hour with a dated ledger of what changed, exported as CSV and JSON under CC BY. Nothing is self-reported and no vendor is listed or removed for payment.
Every tool listed here sells some judgement about other people’s websites. This page runs the same scan on each vendor’s own homepage that a customer gets: can a named crawler reach it, can a machine read what it got, is there a fact it can quote. Nothing is self-reported.
25
tools listed
23
measured and graded
77
median score
11/23
publish llms.txt
0/23
publish an entity map
Re-measured on a rolling cadence, roughly one vendor per hour, so every card is under a day old. Index last rebuilt 2026-09-03 08:17 UTC. Highest today: Sitebulb at 84.
C
Reach95Read69Quote82
2 findings · worst medium✓ llms.txt✗ entity map
C
Reach92Read68Quote82
4 findings · worst medium✗ llms.txt✗ entity map
C
Reach96Read63Quote79
4 findings · worst medium✗ llms.txt✗ entity map
C
Reach89Read68Quote82
3 findings · worst medium✓ llms.txt✗ entity map
B
Reach96Read57Quote82
1 finding · worst info✗ llms.txt✗ entity map
B
Reach100Read76Quote56
1 finding · worst low✓ llms.txt✗ entity map
C
Reach96Read63Quote73
4 findings · worst medium✗ llms.txt✗ entity map
B
Reach89Read76Quote68
2 findings · worst info✓ llms.txt✗ entity map
C
Reach92Read68Quote71
2 findings · worst medium✓ llms.txt✗ entity map
C
Reach89Read69Quote73
3 findings · worst medium✓ llms.txt✗ entity map
C
Reach93Read62Quote70
2 findings · worst medium✓ llms.txt✗ entity map
C
Reach94Read62Quote67
5 findings · worst medium✗ llms.txt✗ entity map
C
Reach90Read48Quote80
5 findings · worst medium✗ llms.txt✗ entity map
C
Reach96Read48Quote68
5 findings · worst medium✗ llms.txt✗ entity map
C
Reach70Read68Quote81
4 findings · worst medium✓ llms.txt✗ entity map
C
Reach84Read56Quote69
2 findings · worst medium✓ llms.txt✗ entity map
C
Reach85Read56Quote60
0 findings✓ llms.txt✗ entity map
C
Reach84Read49Quote62
6 findings · worst medium✓ llms.txt✗ entity map
C
Reach100Read57Quote22
3 findings · worst medium✗ llms.txt✗ entity map
C
Reach96Read50Quote35
2 findings · worst medium✗ llms.txt✗ entity map
D
Reach83Read55Quote40
3 findings · worst high✗ llms.txt✗ entity map
F
Reach44Read29Quote60
7 findings · worst critical✗ llms.txt✗ entity map
Refused this scanner — not graded
Refused this scanner — not graded
No vendor in this category yet.
AI visibility monitoring 580
Content and GEO 479
Enterprise SEO 269
SEO suite 576
Site crawler 779
Table view — every row, for copying or comparing
| Tool | Category (ours) | Grade · score | Reach · read · quote | Findings | Last scanned | |
|---|---|---|---|---|---|---|
| Sitebulb sitebulb.com | Site crawler | B | 84 | 100 · 76 · 70 | 2 | 2026-09-03 evidence |
| Rankscale rankscale.ai | AI visibility monitoring | C | 83 | 95 · 69 · 82 | 2 | 2026-09-02 evidence |
| Surfer surferseo.com | Content and GEO | C | 82 | 92 · 68 · 82 | 4 | 2026-09-02 evidence |
| Moz moz.com | SEO suite | C | 81 | 96 · 63 · 79 | 4 | 2026-09-03 evidence |
| Goodie higoodie.com | AI visibility monitoring | C | 81 | 89 · 68 · 82 | 3 | 2026-09-02 evidence |
| Lumar lumar.io | Site crawler | B | 80 | 96 · 57 · 82 | 1 | 2026-09-03 evidence |
| Athena athenahq.ai | AI visibility monitoring | B | 80 | 100 · 76 · 56 | 1 | 2026-09-02 evidence |
| Botify botify.com | Site crawler | C | 79 | 96 · 63 · 73 | 4 | 2026-09-03 evidence |
| Oncrawl oncrawl.com | Site crawler | B | 79 | 89 · 76 · 68 | 2 | 2026-09-03 evidence |
| Writesonic writesonic.com | Content and GEO | C | 79 | 92 · 68 · 71 | 2 | 2026-09-02 evidence |
| Semrush semrush.com | SEO suite | C | 78 | 89 · 69 · 73 | 3 | 2026-09-03 evidence |
| Frase frase.io | Content and GEO | C | 77 | 93 · 62 · 70 | 2 | 2026-09-02 evidence |
| Ahrefs ahrefs.com | SEO suite | C | 76 | 94 · 62 · 67 | 5 | 2026-09-02 evidence |
| Screaming Frog screamingfrog.co.uk | Site crawler | C | 74 | 90 · 48 · 80 | 5 | 2026-09-03 evidence |
| SE Ranking seranking.com | SEO suite | C | 73 | 96 · 48 · 68 | 5 | 2026-09-03 evidence |
| Seobility seobility.net | Site crawler | C | 73 | 70 · 68 · 81 | 4 | 2026-09-02 evidence |
| Similarweb similarweb.com | SEO suite | C | 71 | 84 · 56 · 69 | 2 | 2026-09-03 evidence |
| BrightEdge brightedge.com | Enterprise SEO | C | 69 | 85 · 56 · 60 | 0 | 2026-09-02 evidence |
| Conductor conductor.com | Enterprise SEO | C | 67 | 84 · 49 · 62 | 6 | 2026-09-02 evidence |
| Peec AI peec.ai | AI visibility monitoring | C | 64 | 100 · 57 · 22 | 3 | 2026-09-02 evidence |
| Profound tryprofound.com | AI visibility monitoring | C | 64 | 96 · 50 · 35 | 2 | 2026-09-02 evidence |
| Clearscope clearscope.io | Content and GEO | D | 62 | 83 · 55 · 40 | 3 | 2026-09-02 evidence |
| Siteliner siteliner.com | Site crawler | F | 44 | 44 · 29 · 60 | 7 | 2026-09-02 evidence |
| Otterly otterly.ai | AI visibility monitoring | refused this scanner — not graded | 2026-09-02 evidence | |||
| Scrunch scrunch.ai | AI visibility monitoring | refused this scanner — not graded | 2026-09-02 evidence | |||
Take the data: CSV · JSON, with the report URL behind every score, under CC BY 4.0. Cite it as “CrawlCheck directory, retrieved <date>” — every row regenerates, so a link always shows today’s state.
What changed, across every vendor
Every vendor here has been measured since 14 August, so a change between two readings is a dated fact. A finding code means the same thing before and after a change to our rubric, so appeared, resolved and returned are always shown; a score movement is only published when both readings ran under the same score version.
- 2026-09-03Oncrawl a new finding appeared: https is served without a strict-transport-security headerappeared
- 2026-09-03Botify a new finding appeared: unfinished placeholder text is live on this pageappeared
- 2026-09-03Sitebulb a new finding appeared: https is served without a strict-transport-security headerappeared
- 2026-09-03SE Ranking a new finding appeared: the hsts header asks for browser preloading but does not qualify for itappeared
- 2026-09-02Goodie a new finding appeared: https is served without a strict-transport-security headerappeared
- 2026-09-02Athena a stale edge copy was servedappeared
- 2026-09-02Peec AI score moved 72 → 74score-up
- 2026-09-02Conductor a new finding appeared: NAP_NAME_DRIFTappeared
- 2026-09-02Conductor a new finding appeared: NAP_UNDECLARED_LISTINGappeared
- 2026-09-02Conductor score moved 75 → 73score-down
- 2026-09-02Siteliner resolved: www and the apex both serve the site instead of one redirectingresolved
- 2026-09-02Seobility an answer engine was refusedappeared
- 2026-09-02Seobility a stale edge copy was served againreturned
- 2026-09-02Seobility the homepage no longer read as mostly markupresolved
- 2026-09-02Seobility score moved 83 → 75score-down
- 2026-09-02Oncrawl score moved 82 → 79score-down
- 2026-09-02Botify a stale edge copy was served againreturned
- 2026-09-02Screaming Frog score moved 75 → 76score-up
- 2026-09-02Moz score moved 85 → 83score-down
- 2026-09-02Moz score moved 83 → 85score-up
- 2026-09-01Clearscope no sitemap could be found againreturned
- 2026-09-01Clearscope the sitemap no longer returned HTMLresolved
- 2026-09-01Writesonic a new finding appeared: an entity is missing geographic coordinatesappeared
- 2026-09-01Oncrawl a new finding appeared: an entity is missing geographic coordinatesappeared
- 2026-09-01Siteliner a new finding appeared: www and the apex both serve the site instead of one redirectingappeared
- 2026-09-01Siteliner no llms.txt was foundappeared
- 2026-09-01Siteliner a sitemap became readableresolved
- 2026-09-01Seobility resolved: the cache is still serving a file the origin no longer hasresolved
- 2026-09-01Seobility the stale edge copy clearedresolved
- 2026-09-01Clearscope a sitemap became readableresolved
- 2026-09-01Surfer a new finding appeared: an entity is missing geographic coordinatesappeared
- 2026-09-01Similarweb two schema nodes shared one identifierappeared
- 2026-09-01Screaming Frog a named-agent group shadowed the wildcard rulesappeared
- 2026-09-01Screaming Frog a stale edge copy was servedappeared
- 2026-09-01Moz two schema nodes shared one identifierappeared
- 2026-09-01Moz a named-agent group shadowed the wildcard rulesappeared
- 2026-09-01SE Ranking a new finding appeared: an entity is missing geographic coordinatesappeared
- 2026-09-01SE Ranking a named-agent group shadowed the wildcard rulesappeared
- 2026-09-01SE Ranking resolved: the cache is still serving a file the origin no longer hasresolved
- 2026-09-01Semrush a new finding appeared: the sitemap does not say when anything changedappeared
This is the one thing a single scan can never produce. A tool that starts measuring the day you ask it can tell you what is true now; only a record kept beforehand can tell you what moved. The same ledger runs on any domain under Watch.
How to read it
The score
The same AI visibility score every report on this site uses, under the current score version: reach (was a named crawler served the page), read (is it mostly text and are the machine files parseable), quote (is there a declared, consistent fact), in that order.
What moves it, and what cannot
Only the measurement. No vendor is listed for payment, no listing is removed for payment, and no score is edited on request — the same rule that governs every report here. A vendor who believes a reading is wrong gets a re-scan, published as measured.
Refused and opted out
A vendor that refused this scanner is listed without a grade: a refusal is a fact about our datacentre address, not a defect of the site. A vendor that opts out in robots.txt is listed as opted out, unmeasured, and can reverse it in the same file.
Categories and prices
Categories are ours. They describe what each product is primarily sold as, not what it can do, and they are not scored. Pricing is not listed, because a price we did not measure is a claim we cannot stand behind.
Why this page exists
Every directory of these tools we could find ranks them by self-reported features and affiliate fit, and none turns its own instrument on the vendors it recommends. We scanned 33 of them once and found a 92-to-41 spread and no entity maps. This page is that finding kept alive, in a form that can be quoted and checked.
Questions about this page
QHow are vendors scored?
By the same scan any domain gets, on the vendor’s own homepage: named-crawler reach, machine readability, quotable facts, every section scored and every finding listed with evidence. Scores come only from stored measurements.
QCan a vendor pay to be listed, removed or rescored?
No. Listing is by category, not payment; nothing is removed for payment; a dispute is a re-scan published as measured. A vendor can opt out of scoring with a line in robots.txt and stays listed as opted out.
QHow often is each vendor re-measured?
On a rolling cadence of roughly one vendor per hour, so every row is under a day old, with the index rebuilt after each pass.
QCan I download the directory data?
Yes: /directory.csv and /directory.json, with the report URL for every row, the change events, and a CC BY 4.0 licence.