New: LLM Attribution. See which AI answers send you pipeline →
AEO Fundamentals9 min read

When Does ChatGPT Search the Web Instead of Answering From Memory?

ChatGPT searches the web when a question needs current, specific or niche facts, and answers stable questions from training memory. What brands do for each.

A marketing director on an early-morning commuter train comparing two printed pages side by side, one marked with small notes down the margin and one plain, pencil in hand
On this page

When does ChatGPT search the web?

ChatGPT may run a web search when it judges that a question would benefit from current information, and it makes that call per question, without asking you.

OpenAI has described the same per-question choice since it launched ChatGPT search on October 31, 2024. Its web search guide for developers applies the same rule to the API.

Any buyer can land on a searched answer: OpenAI's help center says web search is available on ChatGPT Free, Go, Plus, Pro, Business, Enterprise and Edu, and to people who are not signed in.

In OpenAI's study of consumer use, 49% of ChatGPT messages were "Asking", meaning people seeking information or advice.

What makes ChatGPT answer from memory instead?

ChatGPT tends to answer from memory when the answer looks settled: a definition, a concept, a how-to whose steps have not changed.

OpenAI does not publish a list of what skips search, so the clearest written rule comes from Anthropic, whose web search tool docs say Claude answers directly without searching when a request draws on stable knowledge.

Retrieval research gives the reasoning. The PopQA paper by Mallen and colleagues proposes retrieving outside information only when necessary. The Self-RAG paper adds that retrieving every time, whether or not it is needed, can lead to unhelpful answers.

In practice, the wording of the question is the signal: "what is" reads as settled, while the question types in the next section read as time-sensitive. Our checks further down fit that pattern.

How can you tell whether ChatGPT searched?

Look for citations. OpenAI says answers that use web search may include citations you can click to open the source; an answer with none most likely came from memory.

  • Force a search and compare. Type / in the message composer and choose Search, then set that answer beside the unforced one.
  • Remember the uncited reads. OpenAI's developer guide says a search often consults more sources than it cites. A missing citation does not prove your page went unread.
  • Check the citations too. OpenAI warns that search results and citations can be incomplete, outdated or incorrect.
  • Ask more than once. OpenAI says the same question may yield different answers across queries, so one run shows one outcome.

Questions that name your brand, compare vendors or ask what to buy are likely to set off a search, because their answers can change. Anthropic's docs list information about specific organizations, people or products that might have changed as a search trigger.

  • Your brand by name. "What does your company do?" and "Is it any good?" are questions about a specific organization.
  • Best-of and shortlist questions. "Best", "top", "right now" or a year signal a ranking that may have changed.
  • Shopping questions. OpenAI's shopping help page says a question with shopping intent can bring up product options with images, details and merchant links. Products are picked partly from structured metadata such as price and description.
  • Questions about change. Pricing, funding, a new product line or a rebrand.

Memory can still shape a search answer. When it picks products, ChatGPT also weighs the answer its model generated before it looked at new results.

What does answering from memory mean for your brand?

With no search, ChatGPT can only draw on what its model absorbed in training, so your brand appears as the web described it before the cutoff, if it appears at all.

Knowledge cutoffs

Every model stops learning at a date. OpenAI's model pages give GPT-5 a knowledge cutoff of September 30, 2024, and a newer model in its API lineup a cutoff of April 30, 2026.

Anthropic's training data page says Claude Opus 5.5 was trained on data up to June 2026, and that its models may not know about events after their cutoff dates.

Anthropic's models overview also defines a reliable knowledge cutoff: the date through which a model's knowledge is most extensive and reliable. Anything newer is patchier.

The PopQA study probed 10 models and 4 augmentation methods on a dataset of 14k questions. Its authors put the finding plainly: "We find that LMs struggle with less popular factual knowledge, and that scaling fails to appreciably improve memorization of factual knowledge in the long tail".

Retrieval-augmented models largely outperformed models orders of magnitude larger, while models without retrieval stayed competitive on questions about high-popularity entities. For a niche B2B brand, memory answers are where you are most likely to be missing, and search is the better shot.

Rare facts get guessed

OpenAI's research on hallucination says arbitrary low-frequency facts cannot be predicted from patterns alone and lead to hallucinations. Your founding year, pricing tiers and integration list are low-frequency facts unless many pages repeat them.

The same OpenAI research says training and evaluation reward guessing over admitting uncertainty. Correcting those guesses is its own job, covered in how to fix what ChatGPT gets wrong about your brand.

What does a search mean for your brand?

A search gives your current pages a chance at the answer, but only if ChatGPT can reach them, find them with the queries it writes, and rank them.

Your site has to be eligible

OpenAI's help center says a site must allow OAI-SearchBot to crawl it to be eligible for ChatGPT search results. A blocked site can still surface as a navigational link, OpenAI notes.

OpenAI's crawler documentation also covers ChatGPT-User, the agent that opens a page during a conversation: it does not decide search eligibility, and robots.txt rules may not apply to it. The robots.txt setup for each crawler is in our AI crawler guide.

ChatGPT rewrites the question

The query that reaches the search index is usually ChatGPT's, written from your buyer's question. OpenAI says it typically rewrites a question into one or more targeted queries, and after reading the first results it may send more specific follow-up queries.

At launch, OpenAI said ChatGPT search draws on third-party search providers, alongside content supplied directly by partners. Your page has to match the rewritten query, which can be narrower than what the buyer typed, or carry a wrong date (our checks caught one).

Placement is not guaranteed

OpenAI's help center is direct about it: "ChatGPT ranks search results using multiple factors intended to help users find relevant, reliable information. Placement is not guaranteed". Eligibility gets you into the pool; what earns the citation is in how to get cited by AI engines.

Do Claude, Gemini, Google AI Overviews and Perplexity decide the same way?

Mostly: each one searches when fresh or specific facts would help, except Perplexity and Google AI Overviews, as the table below shows. Google's Gemini API docs say grounding lets Gemini cite verifiable sources beyond its knowledge cutoff.

EngineWhen it searchesHow to make it searchWhat else the docs say
ClaudeWhen the request depends on current, changing or out-of-training informationWrite "Search the web" in the prompt; the new Claude experience has no toggleSimple factual queries typically use 1 to 3 searches; comparative research can use 10 or more
Gemini with Google Search groundingThe model judges whether a Google Search would improve the answer, then, if needed, writes and runs its own queriesThe developer turns grounding on; Google Cloud recommends it for up-to-date informationPages that disallow Google-Extended are not used for grounding on Google Cloud
Google AI Overviews and AI ModeOnly when Google's systems judge an overview additive, so they often don't triggerGoogle's systems decideAnswers may fan out into related searches; a page must be indexed and snippet-eligible, per Google Search Central
PerplexityEvery question, in real timeAlways onEvery answer carries numbered citations, per Perplexity's help center

What should your brand do for each route?

Work on memory and search at the same time, because you rarely know which route a buyer's question will take. In order:

  1. Let search crawlers in. Allow OAI-SearchBot in robots.txt and confirm your CDN or firewall lets it through; OpenAI says its search systems can take about 24 hours to reflect a robots.txt change.
  2. State stable facts the same way everywhere. Your name, category, product names and pricing model should read identically on your site, profiles and directories, so a model sees one version often enough to learn it. That consistency is the core of building a brand entity AI engines recognize.
  3. Get onto the pages search already finds. For best-of questions, the third-party lists and reviews a search pulls in decide who gets named; our guide to getting into AI best-tools lists covers how.
  4. Write for the follow-up query. Publish pages that answer the narrow version of the question (your category for one industry, pricing, comparisons, integrations) with dates and specifics a rewritten query can match.
  5. Publish clean product data. E-commerce and DTC brands should keep structured feeds and markup complete for the shopping picks described above.
  6. Test both routes on a schedule. Repeat the checks above on your buyer questions and log which brands appear, following a repeatable AI visibility measurement routine.
  7. Check for a name collision. If your brand shares a name or ticker with another company, how AI engines handle a shared brand name explains what to fix.

How we tested this

Every OnlyAEO article starts with an engine check: the buyer's question goes to ChatGPT and Claude first, we read each cited page in full, and each search the engines ran shapes a section.

For this piece we also put a few other questions to both engines, through OpenAI's API and Anthropic's API, with a web search tool available and the model choosing whether to use it.

  • This article's question got a search. Both engines searched; ChatGPT cited only OpenAI's own help and developer pages, while Claude cited marketing blogs.
  • A definition got none. Asked "What is answer engine optimization?", neither ChatGPT nor Claude searched.
  • "Right now" set off a search spree. On a question asking for the best AEO agencies for business-to-business SaaS companies right now, both searched, and ChatGPT ran more searches than on all our other questions combined. Its first query carried last year's date, which suggests its sense of "now" came from training. OnlyAEO was not named.
  • Our own name got a collision check. On "What does OnlyAEO do?", both searched and cited onlyaeo.com. ChatGPT also ran a search pairing OnlyAEO with American Eagle, whose stock ticker is AEO, and cited Wikipedia to confirm the two are different companies.
  • How-tos split the engines. ChatGPT answered from memory on how to add FAQ schema markup, while Claude ran a single search for Google's current eligibility rules. The day before, ChatGPT also skipped search on how to fix wrong information AI assistants give about a brand.

The checks have limits. Each question ran once per engine, through the API, which is not the consumer ChatGPT app, and OpenAI's system card notes that ChatGPT has browsing on by default while many API queries do not use browsing tools. The app may search more often than our checks did.

Our AI visibility platform has ChatGPT, Claude and Gemini on by default with web search, and runs every prompt twice per engine.

Where does OnlyAEO fit?

OnlyAEO is an AEO platform, and our team runs it for clients, so the split between search and memory comes up in our client work. When we report on a brand, we count the answers where AI recommends it separately from answers that only mention it in text or only link to it as a source.

Every article we publish goes through brand voice matching, citation and source verification, human-in-the-loop review, internal linking and an SEO safety check.

To see where you appear for your buyer questions, start with our free AI visibility audit, delivered within 48 hours at no cost and covering ChatGPT, Claude, Gemini and DeepSeek.

More questions about when ChatGPT searches the web

Does ChatGPT's memory feature change what it searches for?

It can. OpenAI says that when memory is enabled, ChatGPT may use relevant saved memories when it rewrites a search query. Two buyers typing the same question can send different queries.

Can I keep my content out of OpenAI's training and still appear in ChatGPT search?

Yes. OpenAI's crawler docs say GPTBot crawls content that may be used to train its models, and a site can disallow it while allowing OAI-SearchBot for search. Google's crawler docs say blocking Google-Extended does not affect inclusion or ranking in Google Search.

Are ChatGPT's product picks paid placements?

OpenAI's shopping help page says product results are selected independently by ChatGPT, are not ads and are not influenced by OpenAI partnerships.

Are ChatGPT answers more accurate when it searches?

OpenAI reported that with web search on, GPT-5 answers to prompts like real ChatGPT traffic were about 45% less likely to contain a factual error than GPT-4o. Those are OpenAI's own model comparisons, so they say nothing about how accurate an answer about your brand will be.

Does ChatGPT deep research search differently?

It often searches far more. OpenAI's developer docs say deep research runs web searches as part of the model's reasoning and often taps hundreds of sources.

AEO FundamentalsAI VisibilityCross-Platform AEOB2B

← Back to all articles · More in AEO Fundamentals

Find out what AI says about you.

In a 30-minute call we ask ChatGPT, Claude, Gemini and Perplexity the questions your buyers ask, live. You see which brands they name instead of you, and leave with a baseline to measure against.

Talk to an expertNo commitment.
  • SOC 2 Type II compliant
  • Human review on every page
  • Every claim source-checked