Disdain Data Diving

  |  August 4, 2011   |  Comments

Marketing optimization today requires the ability to ask tough questions of huge datasets comparing lots of factors down to a gnat's whisker - very fast. Are you prepared?

Everybody tells you to go deep. Do a deep data dive on that massive warehouse of customer ones and zeros and you're sure to come up with new insights and be able to target your audience better.


Data diving is the wrong analogy for the job.

If you're looking for gold, you have to dig deep.
If you're mining diamonds, you need to dig deep.
If you're after sunken treasure, you have to dive deep.

But customer insight comes from casting your net wide and taking in a great deal of data rather than targeting a single fact.

Today's Big Data heavy-lifting machines and software systems were built back in the day when millions of customers made millions of phone calls and each one had to be captured, stored, and found in a heartbeat. Banking and credit card transactions by the billions had to be put into safekeeping somewhere they could be added up, averaged, and recalled if need be.

We got very smart about cross-referencing things based on their row and column. How many people bought a TV in June? How much money is being taken out of ATMs in this city? How often did they order this with that?

These were questions that could not be answered without pulling the right cube from the Big Data system and waiting until the next morning for the answer.

New Questions Require New Technologies

Yes, Moore's Law ensures that the hardware gets faster every day. But the software needs to keep pace with the sort of puzzles we're dealing with today.

I recently wrote a white paper for Calpont Corp. on this very subject called, "Online Marketing Analytics Managing Big Data is Not Enough." (Registration required.) In my research conversations with Calpont Chief Technology Officer Jim Tommaney, I was struck by his words when discussing this issue in terms on banner ad targeting.

Tommaney said that we've solved the problem of finding the needle in the haystack. The problem for today's advertiser is finding all the needles and classifying them by similarity of their fingerprints.

The days of reaching a massive audience and hitting them with an onslaught of frequency is no longer economical nor tolerated. Noise is no longer the advertiser's friend. Today, we must rely on signal…relevancy.

To find the right audience for your offerings today, you have to do better than:

Contextual: They are looking at a golf website
Demographic: They fall into the right age range and educational accomplishments
Behavioral: They searched for "golf clubs" and then "drivers" and then "Taylor Made Burner SuperFast"

That's certainly deep, but casting your net wide means being able to ask highly complex queries across copious individual elements, cross-referencing a multitude of associated attributes that allow for very fine granularity while supporting near a real-time, iterative investigatory process.

In other words, we have to be able to ask tough questions of huge datasets comparing lots of factors down to a gnat's whisker, very fast.

What impact did the header and body copy font sizes have on click-throughs, engagement, and purchase with older surfers on different ad networks at different times of day? And can you adjust that for seasonality?

This is the art of looking for similar fingerprints on a wide variety of needles across multiple haystacks. I need to cross-reference header font size, body font size, age, network, and time period to see which combination got the most click-throughs, the best engagement, and resulted in the most purchases. Oh yeah, and show me those purchases ranked by profitability.

Each of those elements has six or eight attributes, which creates a permutation correlation matrix that brings Big Hardware to its knees.

So the next time somebody tells you they love to do deep data diving, congratulate them on finding that one in a million record in that haystack in the cloud. But you need to find a million similar records across billions of instances in order to optimize your marketing. Widening your analytics is the only way.


ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Oct 3 to take advantage of Early Bird Rates!


Jim Sterne

Jim Sterne is an international consultant who focuses on measuring the value of the Web as a medium for creating and strengthening customer relationships. Sterne has written eight books on using the Internet for marketing, is the founding president and current chairman of the Digital Analytics Association and produces the eMetrics Summit and the Media Analytics Summit.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!



Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising
If you're considering implementing a marketing attribution model to measure and optimize your programs, this paper is a great introduction. It also includes real-life tips from marketers who have successfully implemented attribution in their organizations.



    • Web Writer
      Web Writer (Money Map Press) - BaltimoreDo you have a passion for the markets and investing, and writing? Do you want to spend your days providing...
    • Web Production Specialist
      Web Production Specialist (Money Map Press) - BaltimoreMoney Map Press is looking for a self-starter to perform and oversee the production of daily...
    • Internet Marketing Campaign Manager
      Internet Marketing Campaign Manager (Straight North, LLC) - Downers GroveWe are looking for a talented Internet Marketing Campaign Manager...