Diagnosing Search Traffic Drops, Part 3

  |  April 18, 2007   |  Comments

How to identify and correct search engine traffic drops. Part 3 of a series.

In the first two parts of this series (Part 1 and Part 2), I identified some important search-based metrics to watch for during the good times, and began to outline ways to identify site problems.

Now we'll look at the remaining metrics and suggest ways to correct the traffic drops that accompany their decline.

Index Counts

Monitoring index counts on a daily basis can cause a great deal of stress and anxiety. Even when site performance is normal, search engine index counts can fluctuate wildly. As with the other metrics I've discussed, I would consider a sharp drop in index count a concern only when it accompanies a drop in traffic, and then, only if you can assume beyond a reasonable doubt the index count drop is causal, not coincidental, to the traffic drop. In other words, if your index count drops by 30 percent at Google, but the newly-missing pages never brought in search traffic anyway, plummeting index counts aren’t the source of your traffic problem.

That said, index count drops are particularly vexing because without an encyclopedic knowledge of your site's content and a solid "theoretical" index count in your head (i.e. the number of pages your site "should" have, based on your calculations), it can be hard to know exactly which pages were previously indexed but no longer are.

Canonical filtering is a possible reason behind an index count drop. If you have pages indexed under both the www and non-www version of your site, make sure one redirects (via 301) to the other. In the short term, this can halve your index count overnight and cause a brief lag in search traffic (especially if pages from both the www and non-www version are performing well). In the long term, your site is stronger for it.

If you can identify particular "veins" of pages that dropped out of the index, consider altering your site's navigational structure to ensure crawlers have more opportunities to find the missing pages. In addition, examine the content of pages that dropped from the index to see if it’s similar to other content, either on your site or on others. This is a particularly difficult situation for catalog sites, as their primary content consists of displaying manufacturer-generated sales copy. Overall, unique, user-focused content with multiple, engine-friendly (i.e., href-based) links to it (both inbound and possibly from third-party sites) shouldn’t have problems being indexed.

Last week, the major search engines sponsoring Sitemaps.org provided users with an additional way to show their content to crawlers: By merely adding the URL of your XML sitemap feed to your robots.txt file, engines will now automatically discover its location. With the recent addition of Ask.com to the list of participating engines, an XML sitemap is critical for sites whose pages aren’t fully indexed with a regular crawl.

Inbound Link Counts

Each engine measures (and reports) links differently, so expect constant minor fluctuation and numbers that disagree from engine to engine. The disappearance of 500 links from a single dynamic site probably may have more to say about how an engine sees that site's pages than how it measures links to your site.

If traffic takes a hit and you believe a corresponding drop in inbound links is related, it could mean engines aren't recognizing certain pages, in this case, either pages that used to link to you, or the pages on your site that are linked to. In either case, check to see if those URLs are still indexed.

Another point seems simple, but is worth mentioning: If external sites link to a page on your site that no longer exists, you no longer benefit from any link popularity. Before you remove a page, make sure to implement a 301 redirect to its new version, even if only one external link points to it. (And if you're pulling a page that has no new version, redirect it to the root.)

Also, remember search engines typically show links of all sorts, including links that help your site, links from bad neighborhoods, and "nofollow" links from social bookmarking sites and blog comments. Only the disappearance of high-quality, non-nofollowed links should concern you. If sites no longer link to you for what appears to be an editorial reason, find out why. The site may recently have been redesigned, and external links were dropped by mistake. In such a case, contact the other site's Webmaster.

Another possibility is you might link to sites that make others uneasy about linking to you. Therefore, link only to high-quality, relevant sites. Make sure your site is just as relevant.

Organic Traffic

All the points above are subsets of organic traffic measurement, so there's little more to say about drops in overall organic traffic. But some generalizations are helpful:

  • Know your priorities. Now and then, optimization results in improvement in one engine, and performance loss in another. Due to their relative market shares, I'm willing to suffer losses at Yahoo and/or MSN for a similar improvement at Google because over time, the Google traffic will more than likely compensate for the loss at the other two.
  • Conversions beat traffic any day of the week. If conversions from search traffic are steady or growing, don't worry too much about traffic drops. Such a situation only means you're attracting fewer of the people you didn't need to attract in the first place.
  • ClickZ Live New York Want to learn more?
    Attend ClickZ Live New York March 30 - April 1. With over 15 years' experience delivering industry-leading events, ClickZ Live brings together over 60 expert speakers to offer an action-packed, educationally-focused agenda covering all aspects of digital marketing. Register today!


    Erik Dafforn

    Erik Dafforn is the executive vice president of Intrapromote LLC, an SEO firm headquartered in Cleveland, Ohio. Erik manages SEO campaigns for clients ranging from tiny to enormous and edits Intrapromote's blog, SEO Speedwagon. Prior to joining Intrapromote in 1999, Erik worked as a freelance writer and editor. He also worked in-house as a development editor for Macmillan and IDG Books. Erik has a Bachelor's degree in English from Wabash College. Follow Erik and Intrapromote on Twitter.

    COMMENTSCommenting policy

    comments powered by Disqus

    Get the ClickZ Search newsletter delivered to you. Subscribe today!




    Featured White Papers

    A Buyer's Guide to Affiliate Management Software

    A Buyer's Guide to Affiliate Management Software
    Manage your performance marketing with the right solution. Choose a platform that will mutually empower advertisers and media partners!

    Google My Business Listings Demystified

    Google My Business Listings Demystified
    To help brands control how they appear online, Google has developed a new offering: Google My Business Locations. This whitepaper helps marketers understand how to use this powerful new tool.


      • Website Optimizer - SEO, CRO, Analytics
        Website Optimizer - SEO, CRO, Analytics (Marcel Digital) - ChicagoMarcel Digital, an award winning interactive marketing agency established in 2003...
      • Director of Marketing
        Director of Marketing (Patron Technology) - New YorkDirector of Marketing We are seeking a Director of Marketing to manage and build our marketing...
      • Senior Interactive Producer
        Senior Interactive Producer (Ready Set Rocket) - New YorkWhat You'll Do As a member of our team, the Senior Producer reports directly to our...