What it takes to police search engine spam and how to protect yourself.
What’s widely considered to be spam is common knowledge. There are lots of summaries of things to avoid. Authorities such as Shari Thurow (here and here), Dave Wallace, and Jill Whalen have published recently on the topic.
So why don’t people play by the rules? A few reasons:
What About Standards?
A proposed solution to search engine spam is standards. The idea has floated around for ages, but gone nowhere.
Search engine marketing (SEM) pioneer Paul Bruemmer pushed for search engine optimization (SEO) certification in 1998. As I wrote then, a "rule book" doesn’t mean and end to spam.
A push in 2001 for search engine marketing standards also went nowhere.
Better Search Engine Disclosure?
Want a real solution to spam? The search engines should agree to publish lists of companies they’ve banned. That would help consumers seeking SEM firms to understand which to avoid. If they do use a banned firm, at least they were warned of the consequences of going with a rule breaker.
I’ve suggested this before. The search engines themselves have discussed the idea at various times in the past. It’s never gone forward, as the search engines seem fearful of legal action should they out-and-out label a firm a "spammer."
So it’s with some sympathy I defend Search Engine Marketing Professional Organization (SEMPO) when it comes under fire for not working to ensure its members adhere to search engine spam guidelines.
SEMPO recently posted a FAQ explaining why it declined to do this. This makes me feel even more strongly that if the search engines aren’t brave enough to enforce their own laws, why should the onus be on a third party that doesn’t create the rules?
They Do Enforce!
Of course, search engines do police for spam. If they catch it, a page may be penalized or banned entirely. It’s not the same, nor as effective, as an offenders list for a variety of reasons:
To expand on the last point, Google now provides two ways to learn if it’s removed material due to the Digital Millennium Copyright Act (DMCA), a U.S. law that can cause search engines to bar listings. A 2002 DMCA case involving the Church of Scientology is probably the best-known example.
I don’t believe Yahoo provides copies of DMCA takedown requests. You can get a sense by searching for Yahoo at Chilling Effects. Ironically, this returns requests to Google that were probably bulk directed to Yahoo and other search engines.
Google will also provide on-site notification if it’s removed or suppressed material that may otherwise have shown up in results. Search for "kazaa" and at the bottom of the page, you’ll see this notice:In response to a complaint we received under the Digital Millennium Copyright Act, we have removed 4 result(s) from this page. If you wish, you may read the DMCA complaint for these removed results.
It’s excellent disclosure (and not something I believe the other search engines do). Google not only reveals removed results, you can click to read the complaint it reacted to.
...And Lack of Disclosure
Back to spam. Were you informed material was removed from your search results? Nope. Might there be an economic incentive for search engines to ban sites? Absolutely. That may cause those companies to resort to advertising, the accusation Google came under (and strongly denied) late last year, when many sites lost rankings.
Let’s not single out Google. Long-time search engine marketer Greg Boser nearly received a standing ovation from his peers during a session at Search Engine Strategies in 2002 when he criticized search engines for needing better standards.
An issue Boser singled out was sites would get pulled, later to hear from various search engines how they could get back in via advertising or paid inclusion.
Want a real-life example of the need for disclosure? NetIQ, maker of WebTrends, recently purchased rank checking tool WebPosition. Perhaps someone went to Google and searched for "webposition" to learn more about the software.
Good luck finding WebPosition’s official site. It’s not in the top results -- unusual, given Google built its reputation largely on providing good navigation to official sites. WebPosition has no pages listed in Google at all. I’ve not seen Google list WebPosition’s pages for ages. It’s probably banned. But Google doesn’t confirm these things, of course. And as a searcher, it’s not disclosed to you.
Google doesn’t like the burden popular rank-checking software such as WebPosition places on its system. It warns people not to use it. Ironically, Google has no problem accepting ads for the product from WebPosition’s many resellers.
Let me stress that similar things are happening at other search engines, too. The need for better spam disclosure is universal, not Google-specific.
Better disclosure would help for so many reasons. It would help confused site owners. It would help guide those seeking the many good SEM firms that diligently try to avoid trouble and play by the rules. I’d love to see it happen.
Until then (it could be a long wait), some suggestions:
Want more search information? ClickZ SEM Archives contain all our search columns, organized by topic.
US Consumer Device Preference Report
Traditionally desktops have shown to convert better than mobile devices however, 2015 might be a tipping point for mobile conversions! Download this report to find why mobile users are more important then ever.
E-Commerce Customer Lifecycle
Have you ever wondered what factors influence online spending or why shoppers abandon their cart? This data-rich infogram offers actionable insight into creating a more seamless online shopping experience across the multiple devices consumers are using.
October 13, 2015
1pm ET/ 10am PT
November 12, 2015