analytics-shutterstock-139983946

The Promise of True Digital Measurement — and Its Betrayal

  |  April 21, 2014   |  Comments

The concept of conversion/non-conversion lies at the heart of any critique of digital analytics. And as we move toward a multichannel measurement model, it is perhaps an even more potent indictment of the amped-up promises of digital analytics in general.

Digital advertising exploded partly because the public swooned for digital unlike for any new media in history. But it also promised something the old-fashioned type of advertising could not. It promised to be measurable. Verifiable. It was supposed to be the end of guesswork and the beginning of numerically accurate advertising science.

Advertising science is not new. We already know that audience acceptance has been measured by industries for decades, and with increasing emphasis on data over guesswork. The recent success of the Mad Men series brought the venerable "focus group" into millions of non-advertiser flatscreens. As illustrated in the series, until the advent of digital, advertising science was of a sociological variety. It was the study of people themselves and what they said, and extrapolation of data was an enormous component of its utility.

Nielsen and Anti-Nielsen

Extrapolation of data is required when volume is lacking. The prime example of extrapolation in the delivery of advertising data is the science of television audience measurement developed by the Nielsen company. For decades, its word was law in broadcast media. In television, low ratings meant almost instant cancellation. This was because Nielsen purportedly "knew" how many millions were tuned in (or not) to a broadcast event.

The method by which Nielsen would claim to "know" was by having installed devices on the televisions of several thousand selected homes - a vanishingly tiny percentage of the general population. From this tiny sample, they deployed extrapolation techniques to "enlarge" the data onto a bigger screen. They created mathematical formulae that would take the miniscule sample and play out a thousand into a million and a million into 10 million. For all anyone knows today, it may have been reasonably accurate. Or it may have been wildly incorrect. Without knowing what the many millions of non-Nielsen households were doing, it would be impossible to determine true accuracy.

Validity of extrapolation aside, Nielsen has been a success for two generations because they've been able to demonstrate substance. But digital made substantial claims to be, in effect, the anti-Nielsen. It was supposed to do away with the need for data modeling and extrapolation. It was supposed to tell you how "users" were in fact interacting with digital media with much, much greater accuracy. This new level of accuracy was to be accomplished by measuring actual behavior in unsampled data packets that would result in verifiable "true" counts. If, as Rand Schulman has said, "Creative without conversion equals zero," then digital analytics was supposed to provide unadulterated evidence of how creative drove conversions. This tends to be fairly electrifying stuff for folks who know the code. It means "you can create beautiful commercials in cyberspace, but if your commercials don't get anybody to buy anything, then at best you've gained nothing and probably have wasted your money."

Creative vs. Data - Battle to the Death?

Sufficient budget for digital analytics and data analysis in general are not in place at most enterprises. The need for it is in too many cases only vaguely apprehended by senior management that grew up on "hunches" and "people I know." Analytics success is thwarted by big-advertising "creatives" who build digital campaigns and then purport to accurately self-measure as a courtesy. Self-measurement is not quite an oxymoron, but it does set up a natural conflict of interest. Content creators want to measure themselves the same way a ball team would love to call its own balls and strikes. Except there really wouldn't be any game to play if that's the way it were umpired.

Ask any number of in-house agency analytics specialists and they will likely tell you they often feel like a voice crying in the wilderness. Facts discovered by agency analysts are, if an industry scuttlebutt is to be believed, fungible. They fall victim to the opinion of the senior ad wizard about what worked and what did not. In the end, the enterprise that hired the agency gets little untainted information about how much of its advertising dollar was wasted.

This concept of conversion/non-conversion lies at the heart of any critique of digital analytics. And as we move toward a multichannel measurement model, it is perhaps an even more potent indictment of the amped-up promises of digital analytics in general.

Why is digital analytics failing its promise? How does that contribute to its own destruction - and ultimately to an unhelpful distrust in the verity of an entire class of nonfinancial business data?

ClickZ Live San Francisco This Year's Premier Digital Marketing Event is #CZLSF
ClickZ Live San Francisco (Aug 11-14) brings together the industry's leading practitioners and marketing strategists to deliver 4 days of educational sessions and training workshops. From Data-Driven Marketing to Social, Mobile, Display, Search and Email, this year's comprehensive agenda will help you maximize your marketing efforts and ROI. Register today!

ABOUT THE AUTHOR

Andrew Edwards

Andrew is a digital marketing executive with 20 years' experience servicing the enterprise customer. Currently he is Managing Partner at Efectyv Digital, a digital marketing consulting company, and Managing Partner at Technology Leaders, a web analytics consulting firm he founded in 2002. He combines extensive technical knowledge with a broad strategic understanding of digital marketing and especially digital measurement, plus hands-on creative in the form of the written word, user-experience and traditional design.

His practice is dedicated to building customers' digital marketing success and helping them save money during the process.

He is a writer, a public speaker and a visual artist as well.

He writes a regular column about analytics for ClickZ, the 2013 Online Publisher of the Year. He wrote the groundbreaking "Dawn of Convergence Analytics" report which was featured at the SES show in New York, and the second report in the series will be featured at the same show in San Francisco.

In addition to speaking at SES, he has presented at eMetrics; and his session was voted one of the top ten presentations at the DMA show in Las Vegas. He is speaking again at the DMA in Chicago in the fall of 2013.

In 2004 Andrew co-founded the Digital Analytics Association and is currently a Director Emeritus. He has designed analytics training curricula for business teams and has led seminars on digital marketing subjects.

He was also an adjunct professor at The Pratt Institute where he taught Advanced Computer Graphics for three years. Andrew is also an award-winning, nationally exhibited painter.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

BigDoor: The Marketers Guide to Customer Loyalty

The Marketer's Guide to Customer Loyalty
Customer loyalty is imperative to success, but fostering and maintaining loyalty takes a lot of work. This guide is here to help marketers build, execute, and maintain a successful loyalty initiative.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.

WEBINARS

Jobs

    • Internet Marketing Campaign Manager
      Internet Marketing Campaign Manager (Straight North, LLC) - Fort MillWe are looking for a talented Internet Marketing Campaign Manager to join the...
    • Online Marketing Coordinator
      Online Marketing Coordinator (NewMarket Health) - BaltimoreWant to learn marketing from the best minds in the business? NewMarket Health, a subsidiary...
    • Call Center Manager
      Call Center Manager (Common Sense Publishing) - Delray BeachWanted: Dynamic Call Center Manager with a Proven Track Record of Improving Response...