Matt McGee on the Wild West days of SEO
The history of search engine optimization (SEO) is a fascinating journey of rapid evolution, shifting paradigms, and constant adaptation. Today, SEO is a highly sophisticated discipline driven by machine learning, natural language processing, and complex user-intent algorithms. But it wasn’t always this way. There was a time when the search landscape resembled a lawless frontier—an era often referred to as the “Wild West” of SEO. In a detailed and nostalgic interview, Matt McGee, the former Editor-in-Chief of Search Engine Land, shared his firsthand experiences navigating those early days. From stuffing invisible keywords into footers to witnessing the foundational shifts that defined modern digital marketing, McGee’s insights offer an invaluable history lesson for modern digital marketers, SEO specialists, and tech enthusiasts alike. Discovering Search Marketing in the Late 1990s To truly appreciate how far search technology has come, we must look back to the late 1990s. This was an era when the commercial internet was still in its infancy, and the concept of a search engine was novel to most people. For early webmasters, discovering search marketing wasn’t a matter of taking an online course or earning a certification—it was a process of raw, trial-and-error experimentation. In those days, there were no industry-standard best practices. The early web was a blank slate, and those who figured out how to drive traffic to their websites did so by reverse-engineering how early search algorithms crawled and indexed content. It was during this period of self-guided discovery that McGee and other pioneers stumbled upon the power of search engines. As these early practitioners looked for community and shared knowledge, they began gathering in niche forums and message boards. It was here that early resources began to emerge. Most notably, Danny Sullivan’s early newsletters and resources under the Search Engine Watch banner became the guiding light for a generation of self-taught search marketers. These publications helped formalize what was then a highly fragmented and mysterious industry. The Pre-Google Era: Navigating AltaVista, Excite, and Northern Light Before Google established its monopoly on global search, a diverse ecosystem of search engines competed for dominance. Platforms like AltaVista, Excite, Lycos, and Northern Light were the primary gateways to the web. Ranking on these platforms was vastly different from ranking on Google today. These early search engines relied heavily on simple, on-page checklists. They did not have the sophisticated link-analysis models or user-behavior tracking systems we see today. Instead, they relied almost entirely on direct matching: if a user searched for a term, the engine looked for the page that contained that exact term the most times, or had it placed prominently in the title and meta tags. This rudimentary approach meant that optimizing a page was largely mechanical. If you wanted to rank for a specific keyword on AltaVista, you simply had to ensure that your target keyword appeared more frequently than it did on your competitor’s page. There was no concept of topical authority, semantic search, or search intent; it was a numbers game played with text. The Wild West of SEO: Keyword Stuffing, Cloaking, and Link Networks Because the early algorithms were so simplistic, webmasters quickly realized they could manipulate search results with ease. This gave rise to what McGee describes as the “Wild West” days of SEO—a time when tactics that would get a site permanently banned today were considered standard operating procedures. Keyword Stuffing One of the most common tactics of the era was keyword stuffing. Webmasters would repeat a target keyword hundreds or thousands of times at the bottom of a webpage to artificially boost its keyword density. To prevent this from ruining the user experience, developers would format the stuffed text to match the background color of the website (e.g., white text on a white background). While invisible to human visitors, the search engine crawlers read the hidden text and rewarded the page with high rankings. Cloaking Another prevalent black hat technique was cloaking. This involved delivering one version of a webpage to the search engine spider and an entirely different version to the human visitor. The search engine crawler would see an highly optimized, text-rich page tailored perfectly to its algorithm, while the human user would see a completely different page, often filled with advertisements or unrelated promotional offers. Early Link Networks When Google arrived with its PageRank algorithm, which evaluated the quantity and quality of links pointing to a page, the industry shifted. SEOs quickly adapted by building massive, automated link networks and link farms. These were networks of low-quality websites created solely to link to one another and pass link equity. For a long time, these manipulative link schemes worked incredibly well, allowing low-quality sites to dominate highly competitive search terms. Founding Small Business SEM in 2004 As the industry began to mature, a divide emerged. Most high-level SEO discussions focused on enterprise-level strategies, major e-commerce brands, and massive national campaigns. Small business owners, who stood to benefit immensely from local search visibility, were largely left out of the conversation. Recognizing this gap, Matt McGee launched his blog, Small Business SEM, in 2004. His goal was simple yet impactful: to translate complex, high-level SEO concepts into actionable, practical strategies that small and local business owners could understand and implement. At the time, local search was still in its infancy. McGee’s blog became a vital resource, helping local plumbers, lawyers, and retail shop owners understand how to claim their digital real estate and compete in their local markets. By focusing on the unique challenges of small businesses—such as limited budgets, geographic targeting, and building local trust—McGee helped democratize search marketing during a crucial period of its growth. Joining Search Engine Land and the Rise to Editor-in-Chief The trajectory of McGee’s career changed dramatically thanks to a chance encounter. While attending an industry conference, he crossed paths with Danny Sullivan, the legendary search journalist and co-founder of Search Engine Land, in a hotel lobby. That brief, informal conversation led to an invitation for McGee to write a regular column focusing