What is GPTBot?
GPTBot is OpenAI's web crawler for collecting training data for its GPT models. Blocking it in robots.txt asks OpenAI not to use your content in future training, but it does not affect your visibility in ChatGPT search, which relies on a separate crawler called OAI-SearchBot.
GPTBot is the web crawler OpenAI uses to gather content for training its models. It identifies itself with the user agent GPTBot in server logs, and OpenAI says it respects robots.txt, so publishers can allow or block it with a standard disallow rule. Pages it collects may feed the datasets used to train future GPT models. It is not the crawler that powers ChatGPT search, and blocking it is not the same as opting out of ChatGPT.
OpenAI runs three separate bots, and each does a different job. GPTBot gathers training data. OAI-SearchBot builds and refreshes the index behind ChatGPT search, so it determines whether your pages can be found and cited when ChatGPT answers with live web results. ChatGPT-User fetches a page in real time when someone asks ChatGPT to open a specific link or browse on their behalf. Robots.txt rules apply per user agent, so blocking one bot leaves the other two untouched.
Blocking GPTBot has a narrow effect: it asks OpenAI not to use your pages in future training crawls. It does not remove content that was already collected and trained into existing models, and it does not stop ChatGPT from describing your brand from memory. That memory is often wrong. In a July 2026 Discoverable study of 30 brands, 27 of 30 (90 percent) were misdescribed when AI engines answered purely from memory, and 13 of 30 (43 percent) still were with live web search switched on. A site that blocks GPTBot can still appear in AI answers, just with less say over the source material.
Treat the three bots as separate decisions. Many publishers block GPTBot on principle but leave OAI-SearchBot and ChatGPT-User open, because those two decide whether ChatGPT can cite their pages and send referral traffic. The common mistake is a blanket rule that blocks every OpenAI bot at once, which quietly removes a site from ChatGPT search citations. Discoverable's free AI crawler checker reads your robots.txt and shows which of 12 AI crawlers you currently allow or block, along with whether you publish an llms.txt file, so you can confirm your rules match your intent.