CrawlCheck

Agent conduct

AhrefsBot conduct record

Ahrefs. Not judged: 3 fetches of disallowed paths were counted before 15 October 2026, when no record of the time, path or network was kept, so they cannot be checked. Every such fetch since is recorded.

Conductnot judged
Verified requests2,563 (from Ahrefs’s published ranges)
Forged claims0 — 0% of requests using this name were impersonators
robots.txtdisallowed fetch unrecorded · 47 robots.txt fetches · 3 fetches of disallowed paths (/r/, /backup/, /admin-old/)
Ratemeasured · busiest minute 7 requests (2026-10-13T02:07 UTC), all its addresses combined; no crawl rate is published here, so this is reported, not judged · measured since 2026-10-07
Revalidation0 conditional requests (0% of verified)
Seen here2026-08-14 → 2026-10-16
Other sites, 14 days7 visitor checks: 2 verified, 1 spoofed

verified requests to paths this site's robots.txt disallows for every agent, including a group that names this one; a lower bound before 7 Oct 2026 (per-path map capped at 40 paths) the busiest minute of verified requests observed here since the counter started, all of the operator's addresses combined; a lower bound. This site publishes no crawl rate (its robots.txt has no Crawl-delay), so the rate is reported, never judged

Signed record for this agent: /api/v1/conduct/AhrefsBot (verify with crawlcheck-verify.mjs). Generated 2026-10-16 09:46 UTC; rebuilt every ten minutes.