CrawlCheck

AI crawlers · Search indexes

Amazonbot

Amazonbot is the search index crawler run by Amazon: Amazon. Its operator publishes the IP ranges it crawls from (https://developer.amazon.com/amazonbot/ip-addresses/), so a request carrying the name can be checked against that list.

User-agent tokenAmazonbot
OperatorAmazon
What it doesAmazon
Kindsearch index crawler
Can a request be verified?Yes — published ip feed
Verification sourcehttps://developer.amazon.com/amazonbot/ip-addresses/
In a CrawlCheck scanSent as a request on every scan; a refusal is scored

Allow or block it in robots.txt

User-agent: Amazonbot
Disallow: /
User-agent: Amazonbot
Allow: /

Add a group that names it: "User-agent: Amazonbot" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names Amazonbot, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want.

What blocking it changes

Indirectly. It feeds Amazon. A refusal removes pages from that index, and most AI answer surfaces still draw on search indexes.

What it actually did on crawlcheck.io

Verified requests12,007
Requests using its name from outside its operator's ranges70 (0.6% of claims)
robots.txt fetched0 times
Fetches of paths robots.txt disallows26
Observed2026-08-13 to 2026-10-30

Measured on this site’s own traffic, verified against the operator’s published ranges. Every agent’s record: agent conduct.

Other agents from Amazon

See what Amazonbot and every other named agent receive from your own site: run a free scan. The full catalogue is on AI crawlers and as JSON at /ai-crawlers.json.

Questions about Amazonbot

QHow do I block Amazonbot in robots.txt?
Add a group that names it: "User-agent: Amazonbot" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names Amazonbot, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want.
QHow can I tell if a request from Amazonbot is real?
Its operator publishes the IP ranges it crawls from (https://developer.amazon.com/amazonbot/ip-addresses/), so a request carrying the name can be checked against that list.
QDoes blocking Amazonbot affect whether my site appears in AI answers?
Indirectly. It feeds Amazon. A refusal removes pages from that index, and most AI answer surfaces still draw on search indexes.
QDoes CrawlCheck test my site as Amazonbot?
Yes. Every CrawlCheck scan fetches the homepage as Amazonbot and compares the response with what a browser receives. A refusal of it counts toward the grade, because it costs the site visibility.