7 hard truths about measuring AI visibility and GEO performance
The rise of generative AI has fundamentally shifted the digital landscape, leading to a scramble among brands to establish a presence within Large Language Model (LLM) outputs. This emerging discipline, known as Generative Engine Optimization (GEO), is complex, and the tools designed to measure it are still immature. In this highly commoditized and often exaggerated market, professional integrity demands a clear-eyed look at what is truly measurable versus what is simply marketing hype. For those deeply invested in the search industry—whether as providers of GEO services or as developers of AI visibility tools—misconceptions often lead to inflated claims. It is essential to peel back the layers and confront the uncomfortable realities of how AI performance is assessed. Over the past few months, numerous claims have been circulated as established facts that lack grounding in rigorous data. It is time to clear the air and discuss the seven hard truths about measuring AI visibility and GEO performance. 1. AI search didn’t kill Google search Despite the pervasive narrative pushed by clickbait headlines, venture capitalists eager to promote their portfolio companies, and pitch decks from AI visibility tools, the reality is that AI search has not diminished the traditional search engine market. In fact, current data suggests the opposite: the overall search pie is expanding. To cut through the noise, we must rely on hard data rather than anecdotes or hype cycles. Semrush, in a recent study analyzing over 260 billion clickstreams, found conclusive evidence that the widespread adoption of platforms like ChatGPT has not led to a reduction in Google searches; surprisingly, it has correlated with an increase. This finding holds particular weight, given that Semrush offers its own AI search tracking capabilities, meaning the data isn’t biased toward supporting Google’s longevity. Further reinforcing this position is the State of Search Q2 2025 report published by Datos, in collaboration with industry veteran Rand Fishkin, CEO of SparkToro. This comprehensive analysis shows that Google continues to maintain a dominant market share, holding firm at around 95% across traditional search engines. The data, collected across millions of U.S. devices, confirms that the vast majority of users remain reliant on the conventional search paradigm. Understanding Complementary Search Behaviors The question remains: How can ChatGPT’s user base double, reportedly surpassing 800 million users, while Google’s search volume remains stable or grows slightly? The answer lies in user intent. People are not necessarily replacing Google with ChatGPT; they are using LLMs for different tasks. A September report published by OpenAI illuminates this distinction, detailing how users actually utilize ChatGPT. The critical finding is that only 21.3% of conversations were focused on seeking information. Within that informational slice, a minuscule 2.1% focused on purchasable products, while the bulk (18.3%) was dedicated to seeking specific facts or details. For brands trying to reach potential buyers, that 2.1% is the only truly relevant segment. Even then, many of those interactions are navigationally driven, meaning the user already knows the brand they want and is seeking confirmation or contact information, rather than initiating a true discovery moment. The Search Journey Remains Vital Moreover, the user journey often loops back to traditional search. If a user asks ChatGPT, “What are the best CRM platforms for small businesses?” and the LLM names three brands, the user’s subsequent logical step is usually to conduct a Google search for one of those specific brands to visit the official website, explore features, and evaluate pricing. For commercially driven queries, the website remains the crucial final destination. While the emergence of LLM-integrated browsers might shift this dynamic in the future, the current reality is that AI has expanded the market for information-seeking, positioning itself as a complementary research and drafting tool, not a replacement for the reliable, deterministic index of the web that Google provides. 2. No AI visibility tool can actually get you into AI answers A significant portion of the hype surrounding AI visibility tools echoes the earliest days of the SEO industry. Back then, foundational SEO monitoring tools often promised to “get you to the top of Google,” an impossible feat for software alone. Today, this promise has been recycled: “Our tool will ensure your brand is mentioned by the LLM.” The core principle remains unchanged: Optimization is an executive function, not an automated one. Just as no tool can execute a comprehensive SEO strategy without human oversight, no tool can fully execute Generative Engine Optimization (GEO). The Limits of Automation in GEO A tool can deliver data, surface insights, and offer recommendations, but the actions that fundamentally move the needle—the strategic decisions and high-quality content execution that result in an AI model mentioning a brand—require human judgment. Consider the necessary actions for effective GEO: External Credibility Building: Is the software capable of planting organic, authoritative brand mentions on external, high-ranking sites? This is fundamentally impossible without unethical practices like hacking or spamming. Earning credibility requires human-to-human interaction and content contribution. Content Alignment: While a tool can suggest text edits, are brands truly prepared to grant writing permissions to a SaaS platform for their Content Management System (CMS)? Furthermore, blindly implementing LLM-friendly changes without a holistic SEO review can be disastrous. Content that is easily parsable by an LLM is not automatically guaranteed to be SEO-friendly, and potential conflicts require expert reconciliation. When AI visibility software publishes case studies titled, “How we increased brand mentions in LLMs by X%,” this framing is a deliberate marketing tactic claiming ownership over the final business outcome. The software may have provided the initial intelligence, but the actual, painstaking work—the strategy, the content creation, the authoritative outreach—was executed by the human GEO team or an external agency. The success stems from human execution informed by tool data, not from the tool itself. 3. No one really knows the real search volume of prompts In traditional SEO, keyword research rests on the assumption that search volume data is a quantifiable metric, even if it is an estimate. However, in the realm of LLMs, this foundational data point
