Apple crawlers: what each bot does
Apple runs 2 bots that we document: Applebot-Extended, Applebot. They have different jobs (ai control token, search engine crawler), so a robots.txt rule for one does not apply to the others.
| Bot | Category | robots.txt token | Honors robots.txt? | What blocking does |
|---|---|---|---|---|
| Applebot-Extended | AI control token | Applebot-Extended | Yes (control token) | Apple says disallowing it does not remove pages from search results, and its rules are not considered in Search ranking. |
| Applebot | Search engine crawler | Applebot | Yes, per Apple | Blocking Applebot removes you from those Apple search features. To opt out of model training only, use Applebot-Extended instead. |
Stay findable, opt out of training
If you want Apple's search and fetch bots to keep access but its training bot and control tokens to stay away, this is the robots.txt for it. It is one option, not a recommendation.
User-agent: Applebot Allow: / User-agent: Applebot-Extended Disallow: /
No request from a Apple bot has been recorded on our sites in the last 30 days. Bot traffic data