An engineer assigned to evaluate Google's system as part of a class-action lawsuit concludes that the company's current efforts pass muster. Not so before March 2005, however.
An engineer investigating Google's click fraud detection system has concluded that the company's efforts to combat the scourge are "reasonable." Alexander Tuzhilin, a professor of information systems at NYU, laid out his findings in a report issued as part of a class-action lawsuit against the company.
Google and the plaintiffs in the Arkansas case, Lane's Gifts v. Google, have agreed to a $90 million settlement, but the court is still determining whether to approve the settlement agreement. One of the settlement terms was that a third-party expert be allowed to examine the company's detection methods.
Given Google's secrecy around its click fraud detection systems, Tuzhilin is one of the rare outsiders given the opportunity to probe the company's methods. Tuzhilin reviewed internal documents, interviewed Google personnel and received demos of various systems as he prepared the 47-page report.
Though Tuzhilin reaches the conclusion that current click-fraud efforts are "reasonable," he questions one of the company's policies before March 2005. Before that time, when an ad received a double click, one click followed by an immediate second click, advertisers were charged for both clicks.
"For me, the second click in the double click is invalid. . . and the advertisers should not be charged for it," he wrote. "It is not clear to me why it took Google so long to revise the policy of charging for double clicks. Nevertheless, this policy was revised in March 2005 despite the fact that the company lost 'noticeable' revenues by taking this action."
Tuzhilin also looked at whether economic considerations played any role in the company's operations. For example, he tried to determine if Google benefits financially when click fraud goes undetected.
"As a result of these investigations, I realized that it constitutes exclusively an engineering decision with no inputs from the finance department or the business units, except in. . . two cases," Tuzhilin wrote.
In the first case he describes, one particular IP address was disabled because of inappropriate clicking and a business unit requested an additional investigation because the IP address was associated with an important customer. The second case was the double click policy, which Tuzhilin notes the financial implications were discussed within the company.
In the document, Tuzhilin reveals that Google employs around 36 people on a dedicated click fraud team, about a dozen of which are engineers developing technological systems to detect invalid clicks. The balance of the employees investigate customer inquiries and other incidents in which click fraud is suspected.
Tuzhilin writes that he was surprised to find that most of Google's filters, with a few exceptions, were very simple.
"I was initially certain that these simple filters should miss many types of more complicated attacks," he wrote. "However. . . these simple filters perform reasonably well."
In the report, Tuzhilin suggests other methods, which Google is not using, which might improve click fraud detection filters. These include data mining, using conversion data and developing more advanced types of filters.
Besides the proactive filtering method, Google also uses automated and manual "offline" detection systems. Subtle patterns of click activity that may or may not be valid generate an alert that staffers then investigate manually. The company's systems also automatically alert the team to manually investigate AdSense publishers whose sites seem to be generating invalid clicks. When a publisher is terminated, all the clicks generated from that site over a given period of time are credited back to advertisers.
"My only concern with these manual inspections is about scalability of these inspection processes," Tuzhilin writes. "Since the number of inquiries grows rapidly, so does the number of investigations required to investigate these inquiries."
August 10-12: Revolutionize your digital marketing campaigns at ClickZ Live San Francisco! Educating marketers for over 15 years, our action-packed, educationally-focused agenda covers every aspect of digital marketing. Early Bird rates available through Friday, July 17 - save up to $300! Register today.
Pamela Parker is a former managing editor of ClickZ News, Features, and Experts. She's been covering interactive advertising and marketing since the boom days of 1999, chronicling the dot-com crash and the subsequent rise of the medium. Before working at ClickZ, Parker was associate editor at @NY, a pioneering Web site and e-mail newsletter covering New York new media start-ups. Parker received a master's degree in journalism, with a concentration in new media, from Columbia University's Graduate School of Journalism.
US Consumer Device Preference Report
Traditionally desktops have shown to convert better than mobile devices however, 2015 might be a tipping point for mobile conversions! Download this report to find why mobile users are more important then ever.
E-Commerce Customer Lifecycle
Have you ever wondered what factors influence online spending or why shoppers abandon their cart? This data-rich infogram offers actionable insight into creating a more seamless online shopping experience across the multiple devices consumers are using.