Buyers Ask AI

Why your website does not appear in ChatGPT

Checked against the assistants’ own documentation on 16 November 2026

People mean two things by this question. One is that ChatGPT never links to their pages. The other is that when someone asks it what to buy, it names other businesses and leaves theirs out. The second is the one that costs sales, and it has more than one cause.

The short answer: ChatGPT names a business because it met the name often in the text it was trained on, or because the pages it reads while searching mention it. A site can be shut out by its own crawler rules, by not being in a search index, or by pages that are empty until a script runs. Often the site is fine, and the pages ChatGPT reads simply do not mention the business.

If you only want to know whether the assistants name you, run the free check. It takes about a minute.

Where ChatGPT gets a name from

It has two sources. The first is training: a large body of text collected up to some date, in which your business either came up often enough to stick or did not. The second is the web. ChatGPT can run a search while it answers, read some of the pages it finds and build its answer from them. OpenAI says it searches when a question would benefit from current information, and questions about what to buy often do.

A small or new business can rarely count on training. That leaves the search, and two questions. Can ChatGPT reach your pages? And do the pages it reads mention you?

Three things on your own site that can shut you out

These take a few minutes to check, so check them first.

Your site turns OpenAI’s search crawler away

OpenAI runs separate crawlers. GPTBot collects text for training. OAI-SearchBot is the one behind search, and OpenAI’s documentation says a site that opts out of it will not be shown in ChatGPT’s search answers, though it may still turn up as a bare link. Open the robots.txt file of your site and look for a rule against OAI-SearchBot, or against every crawler. Look also for a “block AI crawlers” switch in your site builder. The two crawlers are set separately, so you can keep GPTBot out and still let search in:

User-agent: OAI-SearchBot
Allow: /

A change takes about a day to reach OpenAI’s systems. If your site sits behind Cloudflare, look there as well. Cloudflare has its own settings for AI crawlers, with search, agents and training set separately, and a block set there applies whatever robots.txt says.

The search engines have not indexed you

ChatGPT does not crawl the whole web for each question. OpenAI says its search sometimes works with other search providers, and its page for Enterprise and Edu accounts names Bing. A site that Bing and Google have not indexed is hard for any assistant to find. Search for your business name on both. If your own site does not come up for your own name, start there: add the site to Bing Webmaster Tools and Google Search Console and submit a sitemap. Google says crawling can take from a few days to a few weeks.

Your pages are empty until a script runs

Many sites send a nearly empty page and fill it in with JavaScript in the visitor’s browser. Google’s crawler runs the scripts. A study of crawler traffic by Vercel and MERJ found that the crawlers of OpenAI, Anthropic and Perplexity fetch the scripts and never run them. The study dates from December 2024 and is not a statement from those companies, so treat it as evidence, not as a rule. To see what such a crawler gets, open “View page source” on a product page and search it for the product’s name and price. If they are not there, a crawler that does not run scripts has not seen them.

The cause that is not on your site

A site can pass all three checks and still not be named. Watch an assistant answer a buying question and the reason shows. It searches, reads a few pages, and names the businesses those pages name: a comparison article, a “best of” list, a review site, a forum thread. If the pages it read do not mention you, you are not in the answer, however good your own site is.

We ran our short check on 83 small businesses on 15 and 16 November 2026: 56 online shops and 27 software companies in 21 countries. We picked them by hand, so this is not a random sample. Each got three questions a buyer might ask, put to ChatGPT and Gemini with the name of the business left out, which gives six answers each. 19 of the 83 were not named in any answer. 45, more than half, were named in two answers or fewer. One was named in all six.

None of the 83 had a robots.txt that turns the assistants’ crawlers away, and none sent a home page that stays empty until a script runs. For 34 of them, the business’s own site was not among the pages the assistants read or linked to in any of the six answers, and all 19 that were never named are among those 34. The full figures, and how we counted.

What helps is specific to your market. Find the pages the assistants read for your buyers’ questions, then get onto them: ask the author of the list to look at your product, answer in the thread, get reviewed on the site that keeps being cited. It is slow, ordinary work. General advice about “optimising for AI” skips the one thing you need to know, which is which pages.

What you do not need

A lot is being sold around this question. Google’s guidance for its own AI features says you do not need an llms.txt file, special markup, content cut into small chunks or pages rewritten for AI systems. It says structured data is not required for those features, and that chasing inauthentic mentions of your brand helps less than it seems. That guidance covers Google’s AI Overviews and AI Mode. The pages OpenAI, Anthropic and Perplexity publish for site owners, linked on this page, are about letting their crawlers in. None of them asks for any of these things.

Gemini, Claude and Perplexity

The same two questions decide it for each of them.

How to see where you stand

Ask the assistants the questions your buyers ask, with your own name left out, from a session that does not know you: signed out, or in a temporary chat. Ask each question more than once, because the names change from one asking to the next. Note who is named and which sites are cited.

Our free check does a small version of this. Enter your address and it reads your pages, writes three buyer questions from them, puts them to ChatGPT and Gemini, and shows you the answers and who was named. There is no sign-up and it does not ask for an email address.

Run the free check

The full report asks 12 buyer questions on ChatGPT, Gemini, Claude and Perplexity, each one twice. It shows who is named in your place, which sites the assistants read before they answer, and up to ten things to do about it, in order of effect. It costs $19. You can read a sample report first.