Product Hunt launch · 20% off your first 3 months withSee pricing →

Apple · policy directive

Is Applebot-Extended blocked on your site?

Applebot-Extended is Apple’s policy directive token for Apple Intelligence training, and whether it reaches you is decided by one line in your robots.txt. Like Google-Extended, this is a directive rather than a crawler: it opts you out of Apple’s model training while leaving plain Applebot, which powers Siri, Spotlight and Safari results, untouched.

  • Not critical if blocked
  • Applebot-Extended robots.txt token

By · Published · Last updated

What is Applebot-Extended?

Applebot-Extended is a robots.txt token, not a crawler. Apple crawls with Applebot, which powers search in Spotlight, Siri and Safari, and reads Applebot-Extended to decide whether that content may be used to train Apple’s generative foundation models, including those behind Apple Intelligence.

Applebot-Extended at a glance
OperatorApple
Purposepolicy directive · Apple Intelligence training
robots.txt tokenApplebot-Extended
In the user-agentNever sent: this token is only read from robots.txt
CrawlRadar weight1 of the crawler-access weights, never flagged critical
Vendor docsApple: About Applebot

How to allow Applebot-Extended in robots.txt

Give Applebot-Extended its own group with Allow: /. A named group overrides the User-agent: * group, so this works even when the wildcard disallows everything:

User-agent: Applebot-Extended
Allow: /

How to block Applebot-Extended in robots.txt

Replace Allow with Disallow. To block only part of the site, disallow that path instead of /:

User-agent: Applebot-Extended
Disallow: /
  • Tokens are matched case-insensitively, but writing Applebot-Extended exactly as the vendor spells it avoids surprises with stricter parsers.
  • Check your CDN and security plugins too: a firewall rule can block Applebot-Extended without any line in robots.txt.

Should you block Applebot-Extended?

Disallowing Applebot-Extended opts you out of Apple’s model training while keeping you in Spotlight, Siri and Safari results, which Apple says remain unaffected. Apple also notes that crawled content can add context to AI answers in Siri and Search; the opt-out for that is the nosnippet meta tag, not this token.

How to verify a request is really Applebot-Extended

You cannot, because no request ever carries the Applebot-Extended name. Apple fetches pages with its regular crawlers and reads Applebot-Extended from robots.txt as a permission. A log line claiming to be Applebot-Extended is not from Apple.

Other policy directive tokens

Apple has no other AI token, but these do the same job for other companies. Each is its own robots.txt line, so deciding on Applebot-Extended decides nothing about them.

Other policy directive tokens
TokenOperatorWhat blocking it costs
Google-ExtendedGoogleIt is a robots.txt directive, not a crawler: no request ever arrives under this name. Disallowing it opts you out of Gemini training and grounding. It does not affect Google Search, including AI Overviews.

Is Applebot-Extended visiting your site?

Your analytics will not tell you. AI crawlers do not run JavaScript, so a tag-based tool such as Google Analytics never records them. Applebot-Extended itself never visits, but Apple’s crawlers do, and CrawlRadar’s collector records them from your own server. To check by hand, the guide to tracking AI crawlers has the log commands and each vendor’s IP lists. See the full AI crawler directory for the other tokens CrawlRadar checks.

Frequently asked questions

  • Does blocking Applebot-Extended remove me from Siri or Spotlight?

    No. Siri, Spotlight and Safari search use Applebot. Apple states that content stays discoverable in those products even when Applebot-Extended is disallowed.
  • Why is there no Applebot-Extended in my server logs?

    Nothing crawls under that name. Requests come from Applebot, and the token is read from robots.txt as a permission about how Applebot’s crawl may be used.

See whether Apple’s crawlers actually visit you

robots.txt says who may crawl; only your own request log says who did. CrawlRadar’s collector records every AI crawler visit, verifies it against the vendor’s published ranges, and shows the pages each one fetched.

14-day free trial.No credit card.

Or start with the free AI crawler checker.