Glossary · Technical
GPTBot
OpenAI's web crawler, used to collect content for training and improving its AI models.
What it does
GPTBot crawls publicly accessible web pages, following the same robots.txt conventions as traditional search crawlers — a site can allow or disallow it specifically by referencing its user-agent name.
Relevance to visibility
Blocking GPTBot doesn't affect a site's current standing in ChatGPT's existing knowledge, but it does prevent that content from informing future model updates and training.
See more terms in the full glossary, or read the AI Visibility 101 guide for the full picture.
Related