Uncovering ChatGPT Search Sources

It’s been almost two years since generative AI burst onto the radars of tech and digital professionals worldwide. Since then, the conversation hasn’t stopped, and the developments keep coming.

Not even 18 months ago, we found that ChatGPT’s local search capabilities were pretty poor. Fast-forward to now, and ChatGPT-4 enables users to search the web in real time, producing local search results similar to Google or Bing.

Hot on the heels of our recent Business Listings Visibility Study, where we analyzed the types of results Google surfaces for local queries, we got straight to work replicating the study for ChatGPT Search. So, ready to dive in?

Methodology and Terminology Used

In this study, we conducted 800 manual local business web searches in ChatGPT, recording the first ten search sources ChatGPT displays in its local results’ ‘Sources.’ It’s important to note that while Google displays results in the hundreds, ChatGPT’s ‘Sources’ can vary significantly—sometimes showing only a handful of sources and other times showing more than ten.

The image below highlights the difference between what ChatGPT displays as results (or answers) to the user query, and the sources for its answers.

We used the exact search terms used within the Business Listings Visibility Study so that we could provide a direct comparison of the results. As we did in that study, we used one ‘transactional’ keyword (e.g. “coffee shop”) and one ‘informational’ keyword (e.g. “best coffee shop”) in searches across 20 different business verticals, using 20 different US cities.

Understanding Definitions Within This Study

For every search result source, we recorded the website name and classification of each website’s ‘type’ using the following criteria:

Search Results Compared

Nearly three-fifths (58%) of all the sources for ChatGPT Search results were business websites. Typically, these were local business websites directly related to the business type or business vertical contained within the search term (e.g. “coffee shop chicago”, “hair salon boston”).

Business websites were also the top result type in the Business Listings Visibility Study (47%). As we noted then, you would generally expect to see business websites dominating search engine results based on the interests and intent of users, so it follows that ChatGPT Search might mimic a similar number of results if it understands intent in the same way.

Business mentions made up more than a quarter (27%) of ChatGPT Search sources across the local searches we conducted. This is significantly chunkier than the 16% we saw for Google’s search engine results. As we’ll get to later on, Wikipedia surprisingly dominates the business mention category throughout this study.

Meanwhile, business directories only made up 15% of ChatGPT Search’s sources. It’s very interesting to note the difference in both the presence and breadth of directory results within this study compared to the business listings study. Not only do directory results show up less for ChatGPT searches than Google searches, but some of the most prominent directories, like Yelp and Facebook, do not appear at all.

The most prominent directory found as a source throughout this study was Three Best Rated, making up almost a quarter of all directory sources (24%), followed by Expertise (18%). Although it seems odd that some of the best-known business directories are missing from the first ten sources, it serves as a reminder that brands and businesses should take the opportunity to boost visibility in all the relevant places, and not just the most well-known ones.

When we look at the breakdown of results for transactional and informational search terms, the pattern stays the same. 

However, informational search terms see more of a level split between business website results (43%), business mentions (35%) and directories (22%), while transactional search term sources are largely skewed towards business websites (72%). 

Healthcare and Wellness

Searches for healthcare and wellness businesses predominantly surface business website results. It largely makes sense when you consider the general nature and urgency of a person needing to find a healthcare business. For more urgent care, they’re less likely to want to spend time comparing business information, and will just want to see which businesses are closest to them on a map.

There are just four terms in this group where business website results appear for fewer than 50% of the first ten ChatGPT sources: ‘best chiropractor,’ ‘best day spa,’ ‘best dentist,’ and ‘best gym.’

In these cases, we see more directory sources, yet there does not seem to be a clear reason for this—particularly when Three Best Rated appears as a directory source for so many different business searches. 

It does make sense that ‘best day spa’ and ‘best gym’ would have a higher percentage of business mentions within ChatGPT Search sources. After all, these are the more wellness-focused businesses, for which potential customers might want to read different types of articles and reviews before making a decision.

Hospitality

The hospitality searches are dominated by a range of business mention results. These include well-known hospitality publications like Thrillist, Eater, and The Culture Trip, while local blogs and news sites like Secret Seattle and San Diego Magazine appear for specific location terms.

It is surprising that directories are not more prominent for hotel searches. While giants like Tripadvisor, Expedia, and Booking.com did appear in source lists, they are largely overshadowed by business mentions. If you think about the results you would see in Google’s SERPs, hotel results tend to be very transaction-led, and travel directories themselves have become commercial comparison or booking platforms—so it could be that this is intentional on ChatGPT’s part.

However, the most common business mention source was Wikipedia, which also seems an odd result for hotel searches. It’s not exactly the glossy, photo-laden review content you might expect from Condé Nast or similar.

Services and Trades

A typical search engine user might expect to see many directory results in the Services and Trades group, such as Thumbtack, Angi, BBB, and so on. It’s surprising, then, that only two of the search terms generated a significant number of directory results in the source lists (“best electrician” at 62%; “best storage facility” at 35%).

It’s also not clear why there is such a difference between the number of directory results appearing for ‘best electrician’ and ‘best storage facility’ searches.

As with the healthcare group, sources for Services and Trades searches are mostly in the business website category. Arguably, there is also some degree of urgency attached to the intent behind local services searches, which might explain why the results are mostly business websites. 

Then again, because ChatGPT Search is still so new, we don’t know enough about how well it understands web search intent.

‘Your Money or Your Life’ (YMYL)

The ‘Your Money or Your Life’ group concerns businesses that can impact clients’ lives, health, and finances. Here, directory results take a stronger share of the sources. 

It makes sense that someone searching for these types of businesses would want to compare professionals and businesses by using directories. Directories provide the opportunity to compare customer reviews and read professional profiles in more of a side-by-side view than simply flicking between business websites.

It’s also notable that these percentages tend to increase for informational terms, where a user is more likely to be looking for a comparison.

Entertainment

The Entertainment group is another interesting one where directories are surprisingly absent, although the findings are similar to those of our business listings study.

Both ‘betting store’ search terms see a very large number of business mentions, which, as we discovered in the Business Listings Visibility Study, is likely due to gambling regulations varying so much from state to state. Therefore, local and trade publications are likely to cover the topics.

Notable Findings

Mentions on Wikipedia

As we touched on in the hospitality and entertainment sections above, Wikipedia makes a surprising number of appearances throughout this study. Generally, where local business searches are concerned, Wikipedia is an uncommon result—particularly to appear within the first ten results. This is likely because, as a largely educational platform, it does not match the ‘informational’ intent behind searches such as ‘best coffee shop’ or ‘best hotel.’

Wikipedia probably appears as a source in ChatGPT Search because the platform is trained on Wikipedia’s articles and media. Although this suggests that LLMs might still have some learning to do regarding search intent, it does highlight the value of a Wikipedia presence—something many business owners and brands might not have previously considered.

The below screenshot highlights an example of a local business with its own Wikipedia entry.

If you’re interested in learning more about the relationship between Wikipedia entries and search engine sources, this guide explains how managing brand entities via Wikipedia can inform Google and influence features like knowledge graphs.

No Forum Presence in ChatGPT

One area we haven’t touched on yet is forums. We first conducted a SERP study to analyze result types in May 2024, when Reddit’s exclusive partnership with Google dramatically altered the types of results being surfaced to users. Since then, the Business Listings Visibility Study found that the presence of forum results had decreased significantly, accounting for just 7% of search results displaying for local business searches.

In the case of ChatGPT Search, it seems to ignore forums completely for local business searches. Although it seems that ChatGPT can access content from Reddit or Quora, based on the response below, there do seem to be limitations preventing ChatGPT from sourcing local business information from it.

Yet, at the time of writing, it appears that the Google-Reddit exclusivity deal is still in place. And it doesn’t explain why other forums like Quora aren’t present in its source lists, other than that ChatGPT might not deem these results ‘helpful’ enough.

How to Appear in ChatGPT Search’s Sources

ChatGPT Search, in its current form, has only been available since October 2024, so it’s unclear just how mainstream it might become as a search engine. Yet we can’t ignore the fact that over 300 million users are using the wider ChatGPT platform weekly, with over one billion messages sent a day. So, that’s a hefty number of people that could use it for local queries.

With that in mind, you want to give your brand the best shot at appearing in ChatGPT Search’s source lists. How?

Optimizing for LLMs

Crystal Carter recently put a guide together on optimizing for large language models (LLMs), so we’d strongly recommend reading this. The document can be quite technical and goes beyond just ChatGPT, but contains actionable insights to consider for ChatGPT, such as:

• Checking release notes and documentation for LLMs to keep up to date with changes
• Reporting inaccuracies regarding your brand as and when you see it
• Optimizing for the search engine that powers the LLM (in this case, Bing powers ChatGPT)

Local Marketing Matters

The good news is that optimizing for ChatGPT Search is not an entirely new area to learn, as the local search tactics that you already employ do make a difference. While the sources for information might vary, ChatGPT generally sources local business information like business reviews and ratings to surface results and inform some of the snippets of information it provides—even including Google reviews.

The prominence of business mentions in this study highlights a significant opportunity in building brand awareness through local link-building. Considering outreach and building relationships with different types of press and publications, like news sites, trade publications, and local blogs, can help secure business mentions in the right places. 

Many LLMs are working on securing partnerships with prominent media outlets to train models on their information, so securing coverage with some of your high-priority media outlets could bring two-birds-one-stone returns.

Summary

As we’ve highlighted, these results are a snapshot of ChatGPT Search right now—and things are moving fast. Even if you’re not quite ready to test the waters of LLM optimization (or GEO), now could be a good time to review your local marketing efforts and ensure your business information is correct and up to date in all the right places.

Have you tested out ChatGPT Search since its launch? Tell us about your experiences, or share your predictions with us! You can catch us over on LinkedIn, X, Blue Sky, or by joining our Facebook community, The Local Pack.

Appendix

Directories as ChatGPT Search Sources

Although business directories only make up 15% of ChatGPT Search’s sources in this study, 50% of all directories were dominated by the following websites:

• Three Best Rated (24%)
• Expertise (18%)
• Tripadvisor (8%)

The remaining 50% of directories are made up of the following:

About the author

Sammy Paget

Sammy is BrightLocal's Content Marketing Manager, focusing on developing marketing-leading insights into what drives visibility, rankings and search success for local businesses.

See all of Sammy's articles (24)