Diagnosing Search Traffic Drops, Part 3

  |  April 18, 2007   |  Comments

How to identify and correct search engine traffic drops. Part 3 of a series.

In the first two parts of this series (Part 1 and Part 2), I identified some important search-based metrics to watch for during the good times, and began to outline ways to identify site problems.

Now we'll look at the remaining metrics and suggest ways to correct the traffic drops that accompany their decline.

Index Counts

Monitoring index counts on a daily basis can cause a great deal of stress and anxiety. Even when site performance is normal, search engine index counts can fluctuate wildly. As with the other metrics I've discussed, I would consider a sharp drop in index count a concern only when it accompanies a drop in traffic, and then, only if you can assume beyond a reasonable doubt the index count drop is causal, not coincidental, to the traffic drop. In other words, if your index count drops by 30 percent at Google, but the newly-missing pages never brought in search traffic anyway, plummeting index counts aren’t the source of your traffic problem.

That said, index count drops are particularly vexing because without an encyclopedic knowledge of your site's content and a solid "theoretical" index count in your head (i.e. the number of pages your site "should" have, based on your calculations), it can be hard to know exactly which pages were previously indexed but no longer are.

Canonical filtering is a possible reason behind an index count drop. If you have pages indexed under both the www and non-www version of your site, make sure one redirects (via 301) to the other. In the short term, this can halve your index count overnight and cause a brief lag in search traffic (especially if pages from both the www and non-www version are performing well). In the long term, your site is stronger for it.

If you can identify particular "veins" of pages that dropped out of the index, consider altering your site's navigational structure to ensure crawlers have more opportunities to find the missing pages. In addition, examine the content of pages that dropped from the index to see if it’s similar to other content, either on your site or on others. This is a particularly difficult situation for catalog sites, as their primary content consists of displaying manufacturer-generated sales copy. Overall, unique, user-focused content with multiple, engine-friendly (i.e., href-based) links to it (both inbound and possibly from third-party sites) shouldn’t have problems being indexed.

Last week, the major search engines sponsoring Sitemaps.org provided users with an additional way to show their content to crawlers: By merely adding the URL of your XML sitemap feed to your robots.txt file, engines will now automatically discover its location. With the recent addition of Ask.com to the list of participating engines, an XML sitemap is critical for sites whose pages aren’t fully indexed with a regular crawl.

Inbound Link Counts

Each engine measures (and reports) links differently, so expect constant minor fluctuation and numbers that disagree from engine to engine. The disappearance of 500 links from a single dynamic site probably may have more to say about how an engine sees that site's pages than how it measures links to your site.

If traffic takes a hit and you believe a corresponding drop in inbound links is related, it could mean engines aren't recognizing certain pages, in this case, either pages that used to link to you, or the pages on your site that are linked to. In either case, check to see if those URLs are still indexed.

Another point seems simple, but is worth mentioning: If external sites link to a page on your site that no longer exists, you no longer benefit from any link popularity. Before you remove a page, make sure to implement a 301 redirect to its new version, even if only one external link points to it. (And if you're pulling a page that has no new version, redirect it to the root.)

Also, remember search engines typically show links of all sorts, including links that help your site, links from bad neighborhoods, and "nofollow" links from social bookmarking sites and blog comments. Only the disappearance of high-quality, non-nofollowed links should concern you. If sites no longer link to you for what appears to be an editorial reason, find out why. The site may recently have been redesigned, and external links were dropped by mistake. In such a case, contact the other site's Webmaster.

Another possibility is you might link to sites that make others uneasy about linking to you. Therefore, link only to high-quality, relevant sites. Make sure your site is just as relevant.

Organic Traffic

All the points above are subsets of organic traffic measurement, so there's little more to say about drops in overall organic traffic. But some generalizations are helpful:

  • Know your priorities. Now and then, optimization results in improvement in one engine, and performance loss in another. Due to their relative market shares, I'm willing to suffer losses at Yahoo and/or MSN for a similar improvement at Google because over time, the Google traffic will more than likely compensate for the loss at the other two.
  • Conversions beat traffic any day of the week. If conversions from search traffic are steady or growing, don't worry too much about traffic drops. Such a situation only means you're attracting fewer of the people you didn't need to attract in the first place.
  • ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
    ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Sept 5 to take advantage of Super Saver Rates!

    ABOUT THE AUTHOR

    Erik Dafforn

    Erik Dafforn is the executive vice president of Intrapromote LLC, an SEO firm headquartered in Cleveland, Ohio. Erik manages SEO campaigns for clients ranging from tiny to enormous and edits Intrapromote's blog, SEO Speedwagon. Prior to joining Intrapromote in 1999, Erik worked as a freelance writer and editor. He also worked in-house as a development editor for Macmillan and IDG Books. Erik has a Bachelor's degree in English from Wabash College. Follow Erik and Intrapromote on Twitter.

    COMMENTSCommenting policy

    comments powered by Disqus

    Get the ClickZ Search newsletter delivered to you. Subscribe today!

    COMMENTS

    UPCOMING EVENTS

    Featured White Papers

    IBM: Social Analytics - The Science Behind Social Media Marketing

    IBM Social Analytics: The Science Behind Social Media Marketing
    80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

    Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

    The Multiplier Effect of Integrating Search & Social Advertising
    Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.

    Resources

    Jobs

      • Digital Marketing Analyst
        Digital Marketing Analyst (GovLoop) - Washington D.C.Are you passionate about audience acquisition? Love effective copy and amazingly effective...
      • Product Specialist
        Product Specialist (Agora Inc. ) - BaltimoreDescription: The Product Specialist is hyper-focused on the customer experience and ensures that our...
      • Partnerships Senior Coordinator
        Partnerships Senior Coordinator (Zappos.com, Inc.) - Las VegasZappos IP, Inc. is looking for a Partnerships Senior Coordinator! Why join us? Our...