Landing Page Testing: Testing for Impact, Not Variations

  |  June 3, 2011   |  Comments

Have you been testing intelligently or have you been guilty of slice-and-dice optimization?

Last column, I shared the following test, which I found "in the wild," and asked readers to identify the variables. Hoping that instead of testing all the variables, you could narrow it down to the most meaningful variables so that you minimize the time and resources needed to complete the test.

tomazo-b

tomazo

Depending on how you want to define your variables, these two pages have around a dozen changes.

Here is my list:

  1. Layout orientation. As I mentioned last time, one is laid out horizontally (A), the other vertically (B).
  2. Different taglines (UVP). A) Make every visitor count. B) A marketplace of landing page designers.
  3. Call to action headline. A) Improve your conversion rates! B) Get started here!
  4. Call to action header background color. A) Darker shade of blue than B.
  5. Call to action graphic. A) No arrow pointing down. B) Has an arrow pointing down.
  6. Call to action button copy. A) Invite me. B) Create account.
  7. Call to action button color. A) Blue to match header. B) Orange for higher contrast.
  8. Call to action button size. A) Full size of form. B) About two-thirds the width of the form.
  9. Call to action form field. A) Four fields to complete. B) Five fields to complete with added company as optional field.
  10. Required text for call to action. A) Has none. B) Has it at top of form.
  11. Point of action assurance. A) Privacy guarantee above call to action button. B) Below button.
  12. Testimonial. A) To the left of the form on top. B) Across the bottom of the page.
  13. Copy. A) Three paragraphs of text. B) Adds fourth paragraph about "A fresh pair of eyes." Also, the order of the paragraphs is changed.

Most of the time, when I see such a list of variations, it would seem that the business is testing for variations first and impact second. Testing has to start with the "why" first. Why will this matter to my customer? Why will changing the layout from horizontal to vertical change their feeling about buying from us?

This goes back to what we all learned in elementary school. You start a test with a hypothesis first. Instead, most companies today throw variables at the wall, sometimes not even aware that they are changing variables and all they look for is what version gave them a lift. This is a great strategy when you have endless resources and time to wait for tests to complete, or when you have a page that is converting at around 70 percent-plus and you want to start fine-tuning it.

So what are the three variables I would test from these two landing pages?

  1. Different taglines (UVP). I would want to test at least three or more very different versions to find what resonates most.
  2. Call to action form field. Whenever we can reduce a form field by 20 percent from five fields to four fields, that should have an impact.
  3. Call to action headline. We want to make sure our offer is clear and this should summarize it quickly.

Did you identify these as the big ideas to test first? Have you been testing intelligently or have you been guilty of slice-and-dice optimization? Testing these three variables first enables us to complete our test in 18 days versus 108, based on the number of variations that need to be tested.

What about testing the call to action button and other variables?

Sure, I would eventually want to test that, but the first goal should be to make sure our offer is viewed as relevant and valuable enough to our visitors to want to complete the call to action. Have you ever stopped yourself from clicking on a button because it was blue and not orange if you found the offer relevant and compelling?

ClickZ Live New York Want to learn more? Join us at ClickZ Live New York 2015
[ALERT] Super Saver Rates Expire January 30. With over 15 years of experience delivering industry leading events, ClickZ Live brings together over 50 expert speakers to deliver an action-packed, educationally-focused agenda covering all aspects of digital marketing. Quick! - Register today to secure your place at the best rate.

ABOUT THE AUTHOR

Bryan Eisenberg

Bryan Eisenberg is coauthor of the Wall Street Journal, Amazon, BusinessWeek, and New York Times bestselling books "Call to Action," "Waiting For Your Cat to Bark?," and "Always Be Testing." Bryan is a professional marketing speaker and has keynoted conferences globally such as SES, Shop.org, Direct Marketing Association, MarketingSherpa, Econsultancy, Webcom, SEM Konferansen Norway, the Canadian Marketing Association, and others. In 2010, Bryan was named a winner of the Direct Marketing Educational Foundation's Rising Stars Awards, which recognizes the most talented professionals 40 years of age or younger in the field of direct/interactive marketing. He is also cofounder and chairman emeritus of the Web Analytics Association. Bryan serves as an advisory board member of SES Conference & Expo, the eMetrics Marketing Optimization Summit, and several venture capital backed companies. He works with his coauthor and brother Jeffrey Eisenberg. You can find them at BryanEisenberg.com.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!

COMMENTS

UPCOMING EVENTS

UPCOMING TRAINING

Featured White Papers

Google My Business Listings Demystified

Google My Business Listings Demystified
To help brands control how they appear online, Google has developed a new offering: Google My Business Locations. This whitepaper helps marketers understand how to use this powerful new tool.

5 Ways to Personalize Beyond the Subject Line

5 Ways to Personalize Beyond the Subject Line
82 percent of shoppers say they would buy more items from a brand if the emails they sent were more personalized. This white paper offer five tactics that will personalize your email beyond the subject line and drive real business growth.

WEBINARS

Jobs

    • E-Commerce Marketing Associate
      E-Commerce Marketing Associate (OmniVista Health) - BaltimoreOmniVista Health is looking to add an E-Commerce Marketing Associate to our expanding...
    • Front End Web Developer
      Front End Web Developer (Agora Financial) - BaltimoreAgora Financial, an independent financial publisher, has an immediate opening for a Front-End...
    • Senior Outside Sales
      Senior Outside Sales (RioSeo) - San Diego~~RioSEO is the leading provider of Local Search technology to multi-store retailers and brands. Our software...