Most people hear “OpenAI crawler” and reach straight for a block rule. That is a mistake with OAI-SearchBot. This is the bot that decides whether your pages can show up when someone asks ChatGPT a question and it searches the web. Block it and your pages are pulled from ChatGPT’s search answers, though they can still appear as plain navigational links. Allow it and your content stays eligible to be surfaced and cited. If you care about being found in AI answers, OAI-SearchBot is the OpenAI bot you usually want to let in.
This guide covers what OAI-SearchBot does, how it differs from the other OpenAI crawlers, whether to allow or block it, and how to manage it on WordPress without breaking your ChatGPT visibility by accident.
What Is OAI-SearchBot?
OAI-SearchBot is OpenAI’s search crawler. In OpenAI’s own words, it “is used to surface websites in search results in ChatGPT’s search features.” It identifies itself with the user agent OAI-SearchBot/1.3 (the full string is Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot). The important line for site owners is OpenAI’s own note that “sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though can still appear as navigational links.” So this bot is tied to your visibility in ChatGPT’s answers, not to model training.
OAI-SearchBot vs GPTBot vs ChatGPT-User
OpenAI runs several crawlers, including an ads crawler called OAI-AdsBot. Three of them decide how your content is discovered and used, and the difference is the whole point. Treat them as one bot and you will either train models you did not mean to feed, or block yourself out of the ChatGPT search answers you actually wanted.
| OpenAI bot | What it does | Usually |
|---|---|---|
| OAI-SearchBot | Surfaces your site in ChatGPT search results | Allow |
| GPTBot | Crawls content that may train OpenAI’s models | Your choice |
| ChatGPT-User | Fetches a page live when a user action in ChatGPT triggers it | Allow |
If you have already decided how to handle the training crawler in our GPTBot allow or block guide, keep this separate. Blocking GPTBot opts you out of training. Blocking OAI-SearchBot opts you out of ChatGPT’s search answers. They are not the same decision, and the same care applies to ChatGPT-User and the other OpenAI crawlers.
Should You Allow or Block OAI-SearchBot?
For most sites, allow it. If you want your pages eligible to appear and get linked in ChatGPT’s search answers, OAI-SearchBot needs access. Blocking it is the quiet way people drop out of ChatGPT’s search answers while thinking they only opted out of AI training. The realistic reasons to block are narrow: staging or private areas you do not want surfaced anywhere, or a deliberate policy to stay out of AI search entirely.
One honest caveat: allowing the bot makes you eligible, it does not guarantee a citation. Being crawlable is the entry ticket, not the prize. And like all crawler rules, this runs on the honor system through robots.txt, which well-behaved bots respect.
How to Control OAI-SearchBot on WordPress
OAI-SearchBot follows robots.txt. To keep it out, add this rule:
User-agent: OAI-SearchBot
Disallow: /To stay eligible for ChatGPT search, do not disallow it. On WordPress the snag is the virtual robots.txt that the platform or an SEO plugin generates, so your edits can be overwritten. Managing it through a proper robots.txt generator for WordPress is cleaner, and the wider WordPress robots.txt setup for AI crawlers is worth following if you are handling several bots at once.
See It Working: ChatGPT Referrals in Your Analytics
Once OAI-SearchBot can reach you and ChatGPT starts linking your pages, referral clicks from ChatGPT arrive tagged with utm_source=chatgpt.com. That tag is how you separate real ChatGPT referral traffic from everything else, which we cover in the guide to tracking ChatGPT traffic with utm_source. Watching both sides, the crawler in your logs and the referrals in your analytics, tells you whether your ChatGPT visibility is actually growing.
Manage Every AI Crawler in One Place
Once you are making deliberate choices about OAI-SearchBot, GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, and the rest, editing robots.txt by hand gets error-prone, especially when a host or SEO plugin keeps rewriting the file. RankReady gives you 31 AI crawler controls, so you can allow OAI-SearchBot while making a separate call on GPTBot, all from one screen, auto-synced to a real robots.txt even if a host plugin tries to intercept it.
It also keeps a citation-bot candidates log, showing fetches from OAI-SearchBot, ChatGPT-User, PerplexityBot, and others, each one timestamped, so you can confirm the search crawler is actually reaching you. It generates an llms.txt file and supports Content Signals directives too. RankReady is free, GPL licensed, with no credit card and zero telemetry. If ChatGPT visibility is the goal, pair this with a wider approach to AI search engine optimization for WordPress.
The Short Version
OAI-SearchBot is the OpenAI crawler that gets you into ChatGPT search, so most sites should allow it. Do not lump it in with GPTBot and block everything OpenAI, because that is how sites drop out of ChatGPT’s search answers without meaning to. Set your robots.txt deliberately, confirm the bot is reaching you, and watch for the ChatGPT referrals that follow.
