Diagnosing Search Traffic Drops, Part 3

  |  April 18, 2007   |  Comments

How to identify and correct search engine traffic drops. Part 3 of a series.

In the first two parts of this series (Part 1 and Part 2), I identified some important search-based metrics to watch for during the good times, and began to outline ways to identify site problems.

Now we'll look at the remaining metrics and suggest ways to correct the traffic drops that accompany their decline.

Index Counts

Monitoring index counts on a daily basis can cause a great deal of stress and anxiety. Even when site performance is normal, search engine index counts can fluctuate wildly. As with the other metrics I've discussed, I would consider a sharp drop in index count a concern only when it accompanies a drop in traffic, and then, only if you can assume beyond a reasonable doubt the index count drop is causal, not coincidental, to the traffic drop. In other words, if your index count drops by 30 percent at Google, but the newly-missing pages never brought in search traffic anyway, plummeting index counts aren’t the source of your traffic problem.

That said, index count drops are particularly vexing because without an encyclopedic knowledge of your site's content and a solid "theoretical" index count in your head (i.e. the number of pages your site "should" have, based on your calculations), it can be hard to know exactly which pages were previously indexed but no longer are.

Canonical filtering is a possible reason behind an index count drop. If you have pages indexed under both the www and non-www version of your site, make sure one redirects (via 301) to the other. In the short term, this can halve your index count overnight and cause a brief lag in search traffic (especially if pages from both the www and non-www version are performing well). In the long term, your site is stronger for it.

If you can identify particular "veins" of pages that dropped out of the index, consider altering your site's navigational structure to ensure crawlers have more opportunities to find the missing pages. In addition, examine the content of pages that dropped from the index to see if it’s similar to other content, either on your site or on others. This is a particularly difficult situation for catalog sites, as their primary content consists of displaying manufacturer-generated sales copy. Overall, unique, user-focused content with multiple, engine-friendly (i.e., href-based) links to it (both inbound and possibly from third-party sites) shouldn’t have problems being indexed.

Last week, the major search engines sponsoring Sitemaps.org provided users with an additional way to show their content to crawlers: By merely adding the URL of your XML sitemap feed to your robots.txt file, engines will now automatically discover its location. With the recent addition of Ask.com to the list of participating engines, an XML sitemap is critical for sites whose pages aren’t fully indexed with a regular crawl.

Inbound Link Counts

Each engine measures (and reports) links differently, so expect constant minor fluctuation and numbers that disagree from engine to engine. The disappearance of 500 links from a single dynamic site probably may have more to say about how an engine sees that site's pages than how it measures links to your site.

If traffic takes a hit and you believe a corresponding drop in inbound links is related, it could mean engines aren't recognizing certain pages, in this case, either pages that used to link to you, or the pages on your site that are linked to. In either case, check to see if those URLs are still indexed.

Another point seems simple, but is worth mentioning: If external sites link to a page on your site that no longer exists, you no longer benefit from any link popularity. Before you remove a page, make sure to implement a 301 redirect to its new version, even if only one external link points to it. (And if you're pulling a page that has no new version, redirect it to the root.)

Also, remember search engines typically show links of all sorts, including links that help your site, links from bad neighborhoods, and "nofollow" links from social bookmarking sites and blog comments. Only the disappearance of high-quality, non-nofollowed links should concern you. If sites no longer link to you for what appears to be an editorial reason, find out why. The site may recently have been redesigned, and external links were dropped by mistake. In such a case, contact the other site's Webmaster.

Another possibility is you might link to sites that make others uneasy about linking to you. Therefore, link only to high-quality, relevant sites. Make sure your site is just as relevant.

Organic Traffic

All the points above are subsets of organic traffic measurement, so there's little more to say about drops in overall organic traffic. But some generalizations are helpful:

  • Know your priorities. Now and then, optimization results in improvement in one engine, and performance loss in another. Due to their relative market shares, I'm willing to suffer losses at Yahoo and/or MSN for a similar improvement at Google because over time, the Google traffic will more than likely compensate for the loss at the other two.
  • Conversions beat traffic any day of the week. If conversions from search traffic are steady or growing, don't worry too much about traffic drops. Such a situation only means you're attracting fewer of the people you didn't need to attract in the first place.
  • ClickZ Live San Francisco August 10-12: Revolutionize your digital marketing campaigns at ClickZ Live San Francisco! Educating marketers for over 15 years, our action-packed, educationally-focused agenda covers every aspect of digital marketing. Early Bird rates available through Friday, July 17 - save up to $300! Register today.

    ABOUT THE AUTHOR

    Erik Dafforn

    Erik Dafforn is the executive vice president of Intrapromote LLC, an SEO firm headquartered in Cleveland, Ohio. Erik manages SEO campaigns for clients ranging from tiny to enormous and edits Intrapromote's blog, SEO Speedwagon. Prior to joining Intrapromote in 1999, Erik worked as a freelance writer and editor. He also worked in-house as a development editor for Macmillan and IDG Books. Erik has a Bachelor's degree in English from Wabash College. Follow Erik and Intrapromote on Twitter.

    COMMENTSCommenting policy

    comments powered by Disqus

    Get the ClickZ Search newsletter delivered to you. Subscribe today!

    COMMENTS

    UPCOMING EVENTS

    Featured White Papers

    US Consumer Device Preference Report

    US Consumer Device Preference Report
    Traditionally desktops have shown to convert better than mobile devices however, 2015 might be a tipping point for mobile conversions! Download this report to find why mobile users are more important then ever.

    E-Commerce Customer Lifecycle

    E-Commerce Customer Lifecycle
    Have you ever wondered what factors influence online spending or why shoppers abandon their cart? This data-rich infogram offers actionable insight into creating a more seamless online shopping experience across the multiple devices consumers are using.

    WEBINARS

    Jobs

    • Sr. Marketing Specialist, PPC
      Sr. Marketing Specialist, PPC (Charter Communications) - StamfordSr. Marketing Specialist, PPC– Digital Marketing Charter Communications...
    • Online Marketing Analyst
      Online Marketing Analyst (FULLBEAUTY Brands ) - New YorkINTRODUCTION: Are you interested in a unique career opportunity where you can represent...
    • Copy Editor
      Copy Editor (ClickZ / Search Engine Watch) - New YorkROLE OVERVIEW The role of the copy editor for ClickZ has many demands. Ultimately, the copy...