Quick answers

AIGrow provides AI visibility monitoring, a business assistant, blog publishing and scoped automation services. Start with the free scan to inspect the output before paying.

Run the free scan

The scan is free and monitoring plans start at $29 a month. The operations audit is $290, the visibility audit is $490, and custom builds receive a written price before work starts.

See the plans

Run the free scan. It reads your site, asks several AI assistants what your customers ask, and points you at one thing. No signup required, and it will tell you if you do not need us.

Start now

Yes. Use the contact form for product, billing, support or project questions. Describe the goal and the system involved so the first reply can be specific.

Contact AIGrow
AI crawlers

Google-Extended: a training crawler run by Google

Google-Extended is a training crawler. It collects pages for this: Gemini training and grounding. Operator: Google.

At a glance

Operator
Google
robots.txt token
Google-Extended
Purpose
Training. Training crawlers collect pages for future models. Keeping them out does not stop the crawlers that fetch pages for answers, which have names of their own.
What it feeds
Gemini training and grounding

What blocking it changes

If you keep Google-Extended out, your pages are left out of what it collects for this: Gemini training and grounding. The crawlers that fetch pages for answers have names of their own, so they can still read your site.

robots.txt lines for Google-Extended

robots.txt is a plain text file at the root of a site (yoursite.com/robots.txt). A group starts with one or more User-agent lines that name crawlers, followed by Allow and Disallow lines for paths. A crawler named in a group follows the groups that name it and ignores the group for every crawler (User-agent: *).

To let it in

User-agent: Google-Extended
Allow: /

To keep it out

User-agent: Google-Extended
Disallow: /

Does your site let it in?

Google-Extended is a name for robots.txt rules only. The crawler check reads robots.txt for it and sends no request as it.

Check whether your site lets Google-Extended in

Other crawlers run by Google

Googlebot
Search: Google Search and AI Overviews

See all 22 AI crawlers

Questions about Google-Extended

Google-Extended is a training crawler. It collects pages for this: Gemini training and grounding. Operator: Google.

That is your choice. Blocking it keeps your pages out of what it collects for this: Gemini training and grounding. It does not block the crawlers that fetch pages for answers.

Add a group with its name and a rule for every path: “User-agent: Google-Extended” followed by “Disallow: /”. To let it in, write “Allow: /” instead.