Quick answers

AIGrow provides AI visibility monitoring, a business assistant, blog publishing and scoped automation services. Start with the free scan to inspect the output before paying.

Run the free scan

The scan is free and monitoring plans start at $29 a month. The operations audit is $290, the visibility audit is $490, and custom builds receive a written price before work starts.

See the plans

Run the free scan. It reads your site, asks several AI assistants what your customers ask, and points you at one thing. No signup required, and it will tell you if you do not need us.

Start now

Yes. Use the contact form for product, billing, support or project questions. Describe the goal and the system involved so the first reply can be specific.

Contact AIGrow
AI crawlers

Applebot-Extended: a training crawler run by Apple

Applebot-Extended is a training crawler. It collects pages for this: Apple Intelligence training. Operator: Apple.

At a glance

Operator
Apple
robots.txt token
Applebot-Extended
Purpose
Training. Training crawlers collect pages for future models. Keeping them out does not stop the crawlers that fetch pages for answers, which have names of their own.
What it feeds
Apple Intelligence training

What blocking it changes

If you keep Applebot-Extended out, your pages are left out of what it collects for this: Apple Intelligence training. The crawlers that fetch pages for answers have names of their own, so they can still read your site.

robots.txt lines for Applebot-Extended

robots.txt is a plain text file at the root of a site (yoursite.com/robots.txt). A group starts with one or more User-agent lines that name crawlers, followed by Allow and Disallow lines for paths. A crawler named in a group follows the groups that name it and ignores the group for every crawler (User-agent: *).

To let it in

User-agent: Applebot-Extended
Allow: /

To keep it out

User-agent: Applebot-Extended
Disallow: /

Does your site let it in?

Applebot-Extended is a name for robots.txt rules only. The crawler check reads robots.txt for it and sends no request as it.

Check whether your site lets Applebot-Extended in

Other crawlers run by Apple

Applebot
Search: Siri and Spotlight

See all 22 AI crawlers

Questions about Applebot-Extended

Applebot-Extended is a training crawler. It collects pages for this: Apple Intelligence training. Operator: Apple.

That is your choice. Blocking it keeps your pages out of what it collects for this: Apple Intelligence training. It does not block the crawlers that fetch pages for answers.

Add a group with its name and a rule for every path: “User-agent: Applebot-Extended” followed by “Disallow: /”. To let it in, write “Allow: /” instead.