CrawlCheck

Guides · 2026-08-28 · By

AI visibility tools compared: what each one actually measures

Every tool in this category runs the same loop. The comparisons all sort on price and engine coverage. The difference that decides whether a tool can help you is which half of the problem it can see.

The category is barely two years old and already crowded. Profound, Peec AI, Otterly, Scrunch, AthenaHQ, Semrush's AI Toolkit, Ahrefs Brand Radar, and a long tail of free graders. Every published comparison ranks them on price, prompt volume and how many engines they cover.

Those are real differences. They are also the small ones. Nearly every tool in this list runs the identical loop: take a list of prompts someone wrote, send them to model APIs on a schedule, count how often your brand is named, and report a percentage over time. The vendors themselves are fairly open about this — the honest comparisons in the category say plainly that these tools measure the gap and do not close it.

So the useful way to compare them is not by price. It is by which half of the problem the tool can observe.

The two halves

Demand sideSupply side
The questionAre you named in the answer?Can the retrieval layer read you at all?
Measured byPrompt monitoring against model APIsFetching your site as a non-browser client
UnitShare of voice, citation rateStatus, content type, cache state, text ratio
Fails howYou are absent and nobody can say whyA file returns 200 and cannot be parsed
VendorsAlmost all of themAlmost none

A demand-side tool tells you that you are not being cited. It cannot tell you that the reason is a cached challenge page sitting on your robots.txt, because it never fetched your robots.txt. It asked a model a question and wrote down the answer.

The categories, by what each can see

CategoryExamplesWhat it measuresWhat it cannot see
Prompt monitorsProfound, Peec AI, Otterly, Scrunch, AthenaHQHow often you are named across a prompt set, over timeAnything about what your server hands a crawler
SEO suite modulesSemrush AI Toolkit, Ahrefs Brand RadarThe same loop, joined to keyword and backlink data you already ownThe same blind spot, inside a bigger dashboard
Free gradersVendor lead magnets, AEO scorersA page against a fixed checklist, usually renderedCache state, crawler-specific refusals, per-identity differences
Schema validatorsRich results tests, JSON-LD lintersWhether markup is well formedWhether the markup was delivered to the client that asked
Machine-layer scannersFew; this oneWhat a non-browser client actually receivesWhether any of it results in a citation
Log verificationServer-side, mostly bespokeWhich crawlers actually arrived, verified against published IP rangesAnything about sites you do not control

The label problem, in three parts

Worth understanding before you buy anything in the first two rows, because it applies to all of them equally and none of it is fraud.

The surface is not the product. The OpenAI API is not ChatGPT — the app performs retrieval, calls tools, and carries personalisation and memory the raw API does not reproduce. Google's AI Overviews is a different system again from the Gemini API. There is no public API for the consumer surfaces, so every vendor measures the thing they can reach and labels it as the thing you asked about.

The sample is somebody's guess. Nobody holds the distribution of what buyers actually type into an assistant — not the vendors, not the model providers. A share-of-voice percentage is a statistic over a hand-picked prompt list presented as a property of your brand. Change the list, change the number.

One answer is one draw. Ask the same model the same question twice and the answers can differ. Ask next week, after a model update, and they differ more. The churn between dated repetitions is the actual signal, and it is the part most tools do not surface, because it makes the headline number look unsteady.

What happened when we scanned the vendors

Thirty-three SEO and AI-visibility vendors were run through the same supply-side scanner they would point at you — crawler-identity checks, machine files, cache behaviour, render path. None was told in advance; every one got the same checks, from the same client, on the same day.

Best vendor site measured92 of 100
Worst that completed a scan41
Publish an llms.txtroughly one in three
Publish an entity mapnone
Median payloadunder one visible word per 20 bytes

Several were serving a cached copy of a machine file that no longer matched their own origin — meaning a crawler and a human are told two different things, by a company that sells judgement about exactly that. One could not be measured at all: every path requested, including one that cannot exist, answered identically. That is a firewall speaking, not a website.

The point is not that these vendors are bad. It is that these checks are not niche requirements only a specialist can meet — and the people selling the advice mostly have not implemented it.

Four questions that separate a measurement from a label

Ask any vendor in this category, including this one:

1. Which surface did you query — the consumer app or an API? If it is an API, the number is about the API.
2. Which model, which mode, which date? Grounded retrieval and generation from weights are different systems and should never be averaged together.
3. Who wrote the prompt list, and what happens to the score if I replace it?
4. What would have to be true for this number to be wrong, and how would I find out? If there is no answer to the fourth, it is not a measurement. A percentage you cannot check is a claim about something nobody measured.

How to actually pick

If nobody has ever verified that answer engines can fetch your site, start there, because a demand-side subscription measures an outcome you have not yet made possible. Across 1,038 scans in the public dataset here, 30.9% were serving a stale cached object to crawlers on the bare URL and 3.4% were refusing at least one answer engine outright while serving browsers normally. No prompt monitor can see either.

Once that is clean and stays clean, a prompt monitor tells you something the supply side cannot: whether any of it produced a citation. The two are complements, and the order is not interchangeable.

Disclosure, since this page is on a vendor's site. CrawlCheck sells one of the categories in that table. Individual vendors are not graded by name anywhere on this site, and no scanned domain is ever published — the 33-vendor figures above are aggregates for that reason. This scanner also cannot grade itself: a Worker cannot fetch its own route, so check our files with any client you like.

Every figure above came out of this scanner.

Point it at your own domain and see the same measurements, free.

Scan a domain — free

Questions this post answers

What is the difference between AI visibility tools?

Less than the comparisons suggest. Almost all of them run the same loop: a prompt list is sent to model APIs on a schedule and brand mentions are counted. They differ mainly on price, prompt volume and engine coverage. The larger difference is category: prompt monitors measure whether you are named, while machine-layer scanners measure whether the retrieval layer can read you at all.

Do AI visibility tools measure ChatGPT?

They measure model APIs. There is no public API for the consumer apps, so every vendor queries what it can reach. ChatGPT the product performs retrieval, calls tools and carries personalisation that the raw API does not reproduce, so an API result is a proxy, not the surface a customer sees.

Which AI visibility tool should I start with?

If nobody has verified that answer engines can fetch your site, start with a supply-side check, because a prompt monitor measures an outcome that is not yet possible. Of 1,038 scans in this dataset, 30.9% served crawlers a stale cached object and 3.4% refused at least one answer engine while serving browsers normally.

Related findings

All guides · The dataset · How the dataset works