Glossary · Technical
Google-Extended
A robots.txt control that lets site owners opt out of having their content used to train Google's Gemini models and improve AI features, without affecting standard Google Search indexing.
Why it's separate from Googlebot
Google-Extended is deliberately distinct from the crawler used for regular Search indexing — a site can continue to appear in normal search results while opting its content out of AI training use specifically.
The trade-off
Opting out affects future AI training only — it doesn't retroactively remove a brand from what Google's models have already learned, and it doesn't affect appearance in Google Search itself.
See more terms in the full glossary, or read the AI Visibility 101 guide for the full picture.