Solely 12% of AI Cited URLs Rank in Google’s High 10 for the Unique Immediate

In a dataset of 15,000 prompts, we discovered that—on common—solely 12% of hyperlinks cited by ChatGPT, Gemini, and Copilot seem in Google’s high 10 outcomes for a similar immediate.

Perplexity is the outlier: practically 1 in 3 of its citations level to pages that rank within the high 10 for the goal question.

We analyzed 4 AI assistants—ChatGPT, Gemini, Copilot, and Perplexity—to measure how usually the URLs they cite or reference overlap with what Google or Bing ranks for a similar question.

On common, the quotation overlap between AI assistants and Google and Bing’s high 10 stands at 11%.

((Google AI overlap complete + Bing AI overlap complete) / 10) = 10.96%

Additional down, we have a look at this damaged down by particular person search engine.

Utilizing information from Ahrefs Model Radar, our information scientist, Xibeijia Guan, searched 15,000 long-tail queries in Google and Bing, then requested those self same inquiries to AI assistants.

Instance queries included:

• “How a lot does it price to put in a safety digital camera?”
• “The right way to get sufficient protein when you possibly can’t eat dairy?”
• “What’s the most cost-effective full complete insurance coverage?”
• “¿Cuál es el mejor suplemento para la recuperación muscular?”

Xibeijia then extracted each seen quotation returned for every query throughout each search and AI indices.

Within the search dataset, she recorded the rating positions of the cited URLs—then categorized them based mostly on whether or not they appeared within the high 10, or high 100 outcomes.

The AI assistants examined embrace ChatGPT (each in-text citations and bottom-of-response references), Gemini, Copilot, and Perplexity.

In response to analysis carried out by our information scientist, Xibeijia Guan, simply 12% of citations in AI assistants additionally rank in Google’s high 10, on common.

((28.6 + 8 + 6.1 + 8.6 + 8.2) / 5) = 11.9%

80% of these citations don’t rank wherever in Google for the unique question—80% is actually the typical of all of the “crimson” columns within the chart above.

The overlap between AI and search citations is smaller than we anticipated, however we now have a few theories as to why that may be.

We’ll get into them slightly later on.

Perplexity aligns closest to Google

Perplexity is an AI assistant that was actually constructed to quote—its purpose is to assist practically each assertion with a supply.

Perplexity is the world’s first reply engine. It searches the web in actual time to ship quick, clear solutions to any query—with sources and citations included…Each reply comes with clickable citations, making it simple to confirm the knowledge and dig deeper if you need.

Perplexity Workforce, Oct 2024

ChatGPT and Gemini, then again, don’t at all times hyperlink out.

Their quotation course of could be very a lot query-dependent, and their inside methods set off searches based mostly on completely different standards.

ChatGPT, for instance, appears to make use of one thing known as the sonic classifier—if the immediate “chance” exceeds a sure threshold (i.e. if the response is much less simple to “predict” based mostly on coaching information), then ChatGPT will carry out an online search.

Perplexity persistently favors content material that ranks nicely in Google, with 28.6% of its cited URLs touchdown within the high 10.

For the opposite AI assistants, that quantity hovers round 8%—and greater than 80% of their citations come from pages that don’t rank in any respect for the goal question.

Since Perplexity focuses closely on citations, it appears logical that its outcomes would align carefully with Google’s.

However, not like Gemini and different AI assistants, Perplexity doesn’t draw on Google or Bing’s index. Actually, it has its personal search index, based mostly on its crawler: perplexitybot.

AI assistants—even people who draw on Google and Bing—seem to question search indexes in a essentially completely different approach. This explains why we’re seeing minimal crossover.

When measuring in opposition to Bing outcomes, overlap stays low within the high 10—hitting roughly 10% on common.

((16.6 + 14 + 8.1 + 8.1 + 3.3) / 5) = 10.02%

Copilot rises to the highest of the record, which is to be anticipated since it’s a Microsoft-owned product that attracts on Bing search outcomes when producing its responses.

Perplexity nonetheless stays one of the crucial Search engine optimization-aligned AI assistants, whereas ChatGPT and Gemini present the least overlap.

This examine builds on our earlier analysis into how usually high-ranking pages get cited in Google’s AI Overviews.

Additional studying:

In these research, we discovered a reasonable constructive correlation between Google rankings and citations in AI Overviews, with 76% of cited URLs coming from pages within the high 10.

Based mostly on the info, it appears as if AI Overviews operate like an extension of conventional search—surfacing outcomes that principally replicate the SERP.

In different phrases, AI Overviews observe the SERPs—AI assistants don’t.

Even the assistants constructed by Google aren’t carefully aligned with Google’s SERPs.

There are clearly different components influencing what will get cited, past simply search rankings.

These variations then get merged utilizing strategies like Reciprocal Rank Fusion (RRF), the place the pages that seem persistently are favored extra.

For instance, a web page that ranks round #6 for “the right way to descale a espresso machine,” “cleansing a Nespresso machine,” and “take away limescale from espresso maker” could be cited over one which ranks #1 for under one in every of these.

Actually, it’s doable that AI assistants might by no means seek for the precise immediate that the consumer inputs—as an alternative it simply acts as a catalyst for different fan-out queries.

For this reason eventual citations received’t at all times rank for the unique immediate.

Personalization can even play a job: the very same search question run by means of AI can result in wholly completely different citations, as a consequence of components just like the consumer’s immediate or dialog historical past.

All of this may increasingly clarify why AI citations don’t at all times mirror the SERPs.

Latest assessments by Aleksis Rylko means that SearchGPT citations carefully resemble Google citations.

Rylko believes ChatGPT might now quietly pull from Google’s search index.

Aleyda Solís corroborated this—she found that ChatGPT makes use of Google as a fallback when Bing pages are inaccessible.

These findings got here as a shock to many, as a result of ChatGPT’s built-in supplier is Bing.

From our personal dataset, we aren’t seeing a lot differentiation in how ChatGPT surfaces each Google and Bing outcomes.

That stated, we collected this information in early July, so outcomes might have modified—particularly on condition that OpenAI is planning to launch its AI-first net browser, and doubtlessly even construct its personal search index, going by the latest memo leak.

We’ll be doing additional analysis to check any quotation shifts.

Wrapping up