Analytics Basics: Maximize Surveys' Effectiveness

  |  February 3, 2009   |  Comments

You've decided to do a user survey in-house. Seven tips to get the data you need and ensure a good user experience. Second in a two-part series.

Last time, I looked at the importance of getting a good understanding of the online user experience through tools such as surveys and other feedback mechanisms. Technology development means these types of tools can be obtained either for free or relatively cheaply, lowering one barrier to adoption.

But just because the tools are cheap doesn't mean the survey needs to be cheap as well; asking for user feedback is all part of the user experience. So if you're looking to run surveys yourself rather than have an agency do it for you, here are some things to consider.

  • Be clear about the survey's purpose. Getting some user feedback is better than getting none, but don't do a survey just to do a survey. Be clear about what you want to know. Write down the survey's objectives and keep them hard and focused. You may have more than one objective, but don't try to answer everything in one go.

  • Keep it short and simple. It's difficult to say exactly how long or short a survey should be, but be as efficient as possible. Stick to the objectives and avoid the temptation to cram too much in. If necessary, do more than one survey on a different user sample or only ask certain people certain questions. Also be careful of your language and question style. It's easy to slip into your own business terminology or market-speak. Your users probably won't understand either one. Above all, make it interesting. Make sure the questions are relevant and the survey is engaging.

  • Work out how much data you need. While some data is better than no data, be wary of basing decisions on a small number of responses. A rule of thumb I use is that 400 responses will give you a reasonable level of accuracy in the answers. Getting loads more won't necessarily give you a lot more accuracy, but it will mean you can filter the data to look at subgroups (e.g., the differences in responses between young people and older people). Once you've worked out how many respondents you're likely to need, work out how many people you need to ask to take the survey to get the right number of respondents. The response rate on surveys can vary enormously. If you haven't run surveys before on your site, you may need to test first.

  • Test before going live. Test the survey on a small number of users before going fully live. This is especially true if you have a survey where the questions that people are asked depends on the answers they've given before. You must check that the survey works well technically and from the user perspective. It's best to spot mistakes early.

  • Keep it ethical. Use your surveys for research purposes only. Don't use them to try to sell people things.

  • See your survey as an extension of your brand. If you use online surveys on your site, then they're part of the user experience. Ensure that survey's tone, design, look, and feel complement the brand. You don't want users having too different an experience. I had a good reminder of this when I was asked to take part in an online survey for a well-known technology brand. The brand image is all about ease of use and good design. The survey was badly designed, looked horrible, and was very difficult to complete. I was so annoyed by the survey that I wrote the brand and told them what I thought.

  • Be prepared for feedback. You'll probably get more feedback than you anticipate. People will either reply to an e-mail invite or write comments in open text boxes. You'll need processes in place to deal with any customer service issues that may bubble up. Many of these may be nothing to do with the Web site, but they need to be dealt with.

Hopefully these tips will help you gain some useful and interesting feedback from users about their online experience. With the range of tools available there's no reason not to get started -- and make it a good experience!

Join moderator and ClickZ columnist Jack Aaronson for Dynamic Display Ads: Putting All Your Best Offers on Display to Double ROI, Thursday, February 5 at 12 p.m. EST. This Webcast will show you how dynamic display ads stream live offers from your Web site to get the right offer to the right customer at the right time.


Neil Mason

Neil Mason is SVP, Customer Engagement at iJento. He is responsible for providing iJento clients with the most valuable customer insights and business benefits from iJento's digital and multichannel customer intelligence solutions.

Neil has been at the forefront of marketing analytics for over 25 years. Prior to joining iJento, Neil was Consultancy Director at Foviance, the UK's leading user experience and analytics consultancy, heading up the user experience design, research, and digital analytics practices. For the last 12 years Neil has worked predominantly in digital channels both as a marketer and as a consultant, combining a strong blend of commercial and technical understanding in the application of consumer insight to help major brands improve digital marketing performance. During this time he also served as a Director of the Web Analytics Association (DAA) for two years and currently serves as a Director Emeritus of the DAA. Neil is also a frequent speaker at conferences and events.

Neil's expertise ranges from advanced analytical techniques such as segmentation, predictive analytics, and modelling through to quantitative and qualitative customer research. Neil has a BA in Engineering from Cambridge University and an MBA and a postgraduate diploma in business and economic forecasting.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!



Featured White Papers

2015 Holiday Email Guide

2015 Holiday Email Guide
The holidays are just around the corner. Download this whitepaper to find out how to create successful holiday email campaigns that drive engagement and revenue.

Three Ways to Make Your Big Data More Valuable

Three Ways to Make Your Big Data More Valuable
Big data holds a lot of promise for marketers, but are marketers ready to make the most of it to drive better business decisions and improve ROI? This study looks at the hidden challenges modern marketers face when trying to put big data to use.