What is Google-Extended?
Google-Extended is a robots.txt token that controls whether Google may use your content to train its Gemini models. It is not a separate crawler, and blocking it does not affect Google Search or AI Overviews.
User-agent: Google-Extended
Disallow: /
Googlebot still crawls the page for Search, and the page can still rank and appear in AI Overviews.
Updated
Guides that cover this
Does blocking AI crawlers hurt your Google rankings?
2 min readNo. Blocking AI training crawlers, including Google's own Google-Extended token, doesn't change your Google rankings, and it doesn't remove you from AI Overviews or AI Mode. Only blocking Googlebot does that, and that removes you from Google Search altogether.
Block AI training but stay in AI search answers
2 min readDisallow GPTBot, ClaudeBot, Google-Extended, Applebot-Extended and CCBot in robots.txt, and keep OAI-SearchBot, Claude-SearchBot, Claude-User, PerplexityBot and Googlebot allowed. The full file is below.