Analytics Basics: Maximize Surveys' Effectiveness

  |  February 3, 2009   |  Comments

You've decided to do a user survey in-house. Seven tips to get the data you need and ensure a good user experience. Second in a two-part series.

Last time, I looked at the importance of getting a good understanding of the online user experience through tools such as surveys and other feedback mechanisms. Technology development means these types of tools can be obtained either for free or relatively cheaply, lowering one barrier to adoption.

But just because the tools are cheap doesn't mean the survey needs to be cheap as well; asking for user feedback is all part of the user experience. So if you're looking to run surveys yourself rather than have an agency do it for you, here are some things to consider.

  • Be clear about the survey's purpose. Getting some user feedback is better than getting none, but don't do a survey just to do a survey. Be clear about what you want to know. Write down the survey's objectives and keep them hard and focused. You may have more than one objective, but don't try to answer everything in one go.

  • Keep it short and simple. It's difficult to say exactly how long or short a survey should be, but be as efficient as possible. Stick to the objectives and avoid the temptation to cram too much in. If necessary, do more than one survey on a different user sample or only ask certain people certain questions. Also be careful of your language and question style. It's easy to slip into your own business terminology or market-speak. Your users probably won't understand either one. Above all, make it interesting. Make sure the questions are relevant and the survey is engaging.

  • Work out how much data you need. While some data is better than no data, be wary of basing decisions on a small number of responses. A rule of thumb I use is that 400 responses will give you a reasonable level of accuracy in the answers. Getting loads more won't necessarily give you a lot more accuracy, but it will mean you can filter the data to look at subgroups (e.g., the differences in responses between young people and older people). Once you've worked out how many respondents you're likely to need, work out how many people you need to ask to take the survey to get the right number of respondents. The response rate on surveys can vary enormously. If you haven't run surveys before on your site, you may need to test first.

  • Test before going live. Test the survey on a small number of users before going fully live. This is especially true if you have a survey where the questions that people are asked depends on the answers they've given before. You must check that the survey works well technically and from the user perspective. It's best to spot mistakes early.

  • Keep it ethical. Use your surveys for research purposes only. Don't use them to try to sell people things.

  • See your survey as an extension of your brand. If you use online surveys on your site, then they're part of the user experience. Ensure that survey's tone, design, look, and feel complement the brand. You don't want users having too different an experience. I had a good reminder of this when I was asked to take part in an online survey for a well-known technology brand. The brand image is all about ease of use and good design. The survey was badly designed, looked horrible, and was very difficult to complete. I was so annoyed by the survey that I wrote the brand and told them what I thought.

  • Be prepared for feedback. You'll probably get more feedback than you anticipate. People will either reply to an e-mail invite or write comments in open text boxes. You'll need processes in place to deal with any customer service issues that may bubble up. Many of these may be nothing to do with the Web site, but they need to be dealt with.

Hopefully these tips will help you gain some useful and interesting feedback from users about their online experience. With the range of tools available there's no reason not to get started -- and make it a good experience!

Join moderator and ClickZ columnist Jack Aaronson for Dynamic Display Ads: Putting All Your Best Offers on Display to Double ROI, Thursday, February 5 at 12 p.m. EST. This Webcast will show you how dynamic display ads stream live offers from your Web site to get the right offer to the right customer at the right time.

ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Oct 3 to take advantage of Early Bird Rates!


Neil Mason

Neil Mason is SVP, Customer Engagement at iJento. He is responsible for providing iJento clients with the most valuable customer insights and business benefits from iJento's digital and multichannel customer intelligence solutions.

Neil has been at the forefront of marketing analytics for over 25 years. Prior to joining iJento, Neil was Consultancy Director at Foviance, the UK's leading user experience and analytics consultancy, heading up the user experience design, research, and digital analytics practices. For the last 12 years Neil has worked predominantly in digital channels both as a marketer and as a consultant, combining a strong blend of commercial and technical understanding in the application of consumer insight to help major brands improve digital marketing performance. During this time he also served as a Director of the Web Analytics Association (DAA) for two years and currently serves as a Director Emeritus of the DAA. Neil is also a frequent speaker at conferences and events.

Neil's expertise ranges from advanced analytical techniques such as segmentation, predictive analytics, and modelling through to quantitative and qualitative customer research. Neil has a BA in Engineering from Cambridge University and an MBA and a postgraduate diploma in business and economic forecasting.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!



Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising
If you're considering implementing a marketing attribution model to measure and optimize your programs, this paper is a great introduction. It also includes real-life tips from marketers who have successfully implemented attribution in their organizations.



    • Internet Marketing Campaign Manager
      Internet Marketing Campaign Manager (Straight North, LLC) - Downers GroveWe are looking for a talented Internet Marketing Campaign Manager...
    • Internet Marketing Specialist
      Internet Marketing Specialist (InteractRV) - DallasInternet Marketing Specialist InteractRV - Anywhere Telecommute, USA SEM | SEO | Content Creator...
    • Tier 1 Support Specialist
      Tier 1 Support Specialist (Agora Inc.) - BaltimoreThis position requires a highly motivated and multifaceted individual to contribute to and be...