An engineer assigned to evaluate Google's system as part of a class-action lawsuit concludes that the company's current efforts pass muster. Not so before March 2005, however.
An engineer investigating Google's click fraud detection system has concluded that the company's efforts to combat the scourge are "reasonable." Alexander Tuzhilin, a professor of information systems at NYU, laid out his findings in a report issued as part of a class-action lawsuit against the company.
Google and the plaintiffs in the Arkansas case, Lane's Gifts v. Google, have agreed to a $90 million settlement, but the court is still determining whether to approve the settlement agreement. One of the settlement terms was that a third-party expert be allowed to examine the company's detection methods.
Given Google's secrecy around its click fraud detection systems, Tuzhilin is one of the rare outsiders given the opportunity to probe the company's methods. Tuzhilin reviewed internal documents, interviewed Google personnel and received demos of various systems as he prepared the 47-page report.
Though Tuzhilin reaches the conclusion that current click-fraud efforts are "reasonable," he questions one of the company's policies before March 2005. Before that time, when an ad received a double click, one click followed by an immediate second click, advertisers were charged for both clicks.
"For me, the second click in the double click is invalid. . . and the advertisers should not be charged for it," he wrote. "It is not clear to me why it took Google so long to revise the policy of charging for double clicks. Nevertheless, this policy was revised in March 2005 despite the fact that the company lost 'noticeable' revenues by taking this action."
Tuzhilin also looked at whether economic considerations played any role in the company's operations. For example, he tried to determine if Google benefits financially when click fraud goes undetected.
"As a result of these investigations, I realized that it constitutes exclusively an engineering decision with no inputs from the finance department or the business units, except in. . . two cases," Tuzhilin wrote.
In the first case he describes, one particular IP address was disabled because of inappropriate clicking and a business unit requested an additional investigation because the IP address was associated with an important customer. The second case was the double click policy, which Tuzhilin notes the financial implications were discussed within the company.
In the document, Tuzhilin reveals that Google employs around 36 people on a dedicated click fraud team, about a dozen of which are engineers developing technological systems to detect invalid clicks. The balance of the employees investigate customer inquiries and other incidents in which click fraud is suspected.
Tuzhilin writes that he was surprised to find that most of Google's filters, with a few exceptions, were very simple.
"I was initially certain that these simple filters should miss many types of more complicated attacks," he wrote. "However. . . these simple filters perform reasonably well."
In the report, Tuzhilin suggests other methods, which Google is not using, which might improve click fraud detection filters. These include data mining, using conversion data and developing more advanced types of filters.
Besides the proactive filtering method, Google also uses automated and manual "offline" detection systems. Subtle patterns of click activity that may or may not be valid generate an alert that staffers then investigate manually. The company's systems also automatically alert the team to manually investigate AdSense publishers whose sites seem to be generating invalid clicks. When a publisher is terminated, all the clicks generated from that site over a given period of time are credited back to advertisers.
"My only concern with these manual inspections is about scalability of these inspection processes," Tuzhilin writes. "Since the number of inquiries grows rapidly, so does the number of investigations required to investigate these inquiries."
On the heels of a fantastic event in New York City, ClickZ Live is taking the fun and learning to Toronto, June 23-25. With over 15 years' experience delivering industry-leading events, ClickZ Live offers an action-packed, educationally-focused agenda covering all aspects of digital marketing. Register today!
Pamela Parker is a former managing editor of ClickZ News, Features, and Experts. She's been covering interactive advertising and marketing since the boom days of 1999, chronicling the dot-com crash and the subsequent rise of the medium. Before working at ClickZ, Parker was associate editor at @NY, a pioneering Web site and e-mail newsletter covering New York new media start-ups. Parker received a master's degree in journalism, with a concentration in new media, from Columbia University's Graduate School of Journalism.
Hong Kong, May 5-6, 2015
Gartner Magic Quadrant for Digital Commerce
This Magic Quadrant examines leading digital commerce platforms that enable organizations to build digital commerce sites. These commerce platforms facilitate purchasing transactions over the Web, and support the creation and continuing development of an online relationship with a consumer.
Paid Search in the Mobile Era
Google reports that paid search ads are currently driving 40+ million calls per month. Cost per click is increasing, paid search budgets are growing, and mobile continues to dominate. It's time to revamp old search strategies, reimagine stale best practices, and add new layers data to your analytics.
May 6, 2015
12:00pm ET/9:00am PT