AI crawlers · Training crawlers
Applebot-Extended
Applebot-Extended is a robots.txt control token run by Apple: Apple training. It is a robots.txt control token, not a crawler: no request ever carries this name, so any request that claims it is not from Apple.
| User-agent token | Applebot-Extended |
| Operator | Apple |
| What it does | Apple training |
| Kind | robots.txt control token (never sent) |
| Can a request be verified? | No — none control token |
| In a CrawlCheck scan | Read from robots.txt; reported, never scored |
Allow or block it in robots.txt
User-agent: Applebot-Extended Disallow: /
User-agent: Applebot-Extended Allow: /
Add a group that names it: "User-agent: Applebot-Extended" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names Applebot-Extended, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want. Because it is a control token, the rule changes how pages may be used, not whether they are fetched.
What blocking it changes
No. It does not change whether pages are fetched; it tells Apple whether pages fetched by its other crawlers may be used for apple training.
What it actually did on crawlcheck.io
| Verified requests | 0 |
| Requests using its name from outside its operator's ranges | 1 (100% of claims) |
| robots.txt fetched | 0 times |
| Fetches of paths robots.txt disallows | 0 |
| Observed | 2026-08-19 to 2026-08-19 |
Measured on this site’s own traffic, verified against the operator’s published ranges. Every agent’s record: agent conduct.
Other agents from Apple
Applebot— Apple / SiriApplebot-Extended-Ads— Apple ads corpus
See what Applebot-Extended and every other named agent receive from your own site: run a free scan. The full catalogue is on AI crawlers and as JSON at /ai-crawlers.json.