What to Consider When Choosing a Testing Platform

  |  July 2, 2013   |  Comments   |  

Companies in Asia can bypass the hurdles that Western markets have faced over the last five years and start taking advantage of more complex testing strategies right away. Here's how.

Previously, I wrote about five steps you can take to start testing and how to grow a successful testing program. Once you've decided to take the plunge into continual optimization, the next step is choosing a testing platform to run your A/B and multivariate tests. With lots of options and maturing vendor solutions, companies in Asia can bypass the hurdles that Western markets have faced over the last five years and start taking advantage of more complex testing strategies right away.

Implementation - the Big Hurdle to Agile Testing

One of the biggest hurdles testing programs have faced is around technical implementation. Simply put, testing doesn't just start and stop with a good idea. There are multiple steps to getting a test off the ground and live on a site. Too often, test ideas lose momentum when the actual implementation needs to take place because developers typically have other responsibilities. So, if testing requires constant code changes, you'll notice a big delay every time you want to run a campaign.

However, if you're only planning to run a few tests per year, don't immediately close the door on tools that require test-specific implementation. The greater point is that if you don't want implementation to be an issue, you should:

  • Map out how many tests you foresee running each year and across which channels.
  • Involve developers early in your vendor selection so they understand their role and have an input on which implementation would work best.
  • Understand how conversions are tracked and if you need integration with your current web analytics solution.

The good news is that many testing vendors have realized that implementation is a big factor to how their tools are used and have begun structuring their interfaces and support systems with the average digital marketer in mind.

Other Factors to Consider

Technical implementation isn't the only thing to consider when you're looking for a testing platform. To make the best choice for your business, you'll also want to understand the following:

  • Price. Of course, the ongoing price of the tool itself will be a big factor in your decision. With different pricing models, you'll need to have a clear idea on how many tests you want to run as well as the average traffic volume your site receives.
  • Test types. Understand which test types the tool can accommodate. A/B and multivariate testing are the obvious two, but you should also think about how a tool runs multivariate campaigns (full or partial factorial) as well as test automation.
  • Channels. Testing doesn't need to be limited to your site or landing pages. With the rise of omni-channel marketing, testing a seamless message across channels will become even more important. If you're just getting started, I recommend sticking to the basics. However, it's good to understand the full range of channels each tool can test on so you're optimizing the areas that matter most to your business.
  • Segmentation. Many tools offer basic segmentation capabilities to look at the key groups that interact with your content, but be sure to gauge how to create more sophisticated segments that truly relate to your business.
  • Targeting. Once you recognize a difference in performance between groups, you'll want to leverage the data to increase conversions. Be sure your tool can target these groups and has the flexibility to assign different amounts of traffic to your creatives.
  • Reporting. Testing platforms will be able to tell you when confidence is reached and the difference between your control and challengers, but think about other ways you will want to break down and integrate this data with the tools you already have.
  • Management. Finally, you'll want to understand the different options you have for access, training, test strategy, and management. Some platforms offer full-service solutions while others require you to run this in-house or through an agency partner.

How to Get Started

  1. Create a team of stakeholders who will help in the vendor evaluation and outline their specific requirements.
  2. Do the research on what solutions are available. Below are two good resources to help you understand current options:
  3. Develop a smaller list of companies you want to receive demos from.
  4. Evaluate the strengths and weaknesses of each solution and decide on the top two candidates.
  5. Test them out! Most solutions offer a free trial so that you can understand how it will function within your business. I encourage you to take this time to push the boundaries to gain a better understanding on each solution's limitations.
  6. Choose a solution and start optimizing your marketing efforts!

The Future of Testing

Testing will become more of a core component of companies' overall marketing strategies. As a result, tools will continue to evolve quickly. Already we are seeing big changes with leaders in the market to integrate their specific solutions into full optimization suites that will hopefully begin to crack the question of, "What do we do with all this big data?"

We will also see the progression of more sophisticated testing scenarios to keep up with the rise of the omni-channel marketing that spans pages, domains, devices, and locations.

Ultimately, over time we should see a more personalized experience that's not just based on a wide set of segmentation factors, but the specific needs and behaviors of every individual user.

Image on home page via Shutterstock.

Subscribe to ClickZ Asia to receive your weekly dose of the region's latest trends, tips, and insights straight to your inbox.

ClickZ Live Toronto Twitter Canada MD Kirstine Stewart to Keynote Toronto
ClickZ Live Toronto (May 14-16) is a new event addressing the rapidly changing landscape that digital marketers face. The agenda focuses on customer engagement and attaining maximum ROI through online marketing efforts across paid, owned & earned media. Register now and save!


Breanne Maliniak

Breanne Maliniak is a user experience and conversion rate optimization consultant. With over 5 years of experience in the digital space, her passion is balancing business and consumer needs to improve her clients’ profitability. With years of consulting for clients of all sizes in B2B and B2C industries, she firmly believes that a company’s success relies on happy customers and works on helping organizations discover and connect user experience to every facet of their business. By doing extensive research, Breanne’s passion for creating targeted data-driven optimization strategies has led to successful projects with marquee clients such as SAP, Four Seasons Hotels & Resorts, Yves Saint Laurent, Hewlett-Packard and Aberdeen Asset Management. In 2010, Breanne was recognized with the HSMAI Adrian Award for the Best Search Marketing Strategy.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!



Featured White Papers

ion Interactive Marketing Apps for Landing Pages White Paper

Marketing Apps for Landing Pages White Paper
Marketing apps can elevate a formulaic landing page into a highly interactive user experience. Learn how to turn your static content into exciting marketing apps.

eMarketer: Redefining Mobile-Only Users: Millions Selectively Avoid the Desktop

Redefining 'Mobile-Only' Users: Millions Selectively Avoid the Desktop
A new breed of selective mobile-only consumers has emerged. What are the demos of these users and how and where can marketers reach them?


    • Contact Center Professional
      Contact Center Professional (TCC: The Contact Center) - Hunt ValleyLooking to join a workforce that prides themselves on being routine and keeping...
    • Recruitment and Team Building Ambassador
      Recruitment and Team Building Ambassador (Agora Inc.) - BaltimoreAgora, www.agora-inc.com, continues to expand! In order to meet the needs of our...
    • Design and Publishing Specialist
      Design and Publishing Specialist (Bonner and Partners) - BaltimoreIf you’re a hungry self-starter, creative, organized and have an extreme...