Real World A/B and Multivariate Testing: Lessons Learned

Design & User Experience
Location: 2005 Level:
Average rating: **...
(2.40, 5 ratings)

After working with your top developers, designers, marketing and user experts you build and release your new website. Unfortunately, after the release you don’t see the desired results. Now you set up A/B or Multivariate tests to evaluate your website. You run the test and get a winner. Now you release the winning test and again you don’t see what you expected.

Testing is here to stay and will solve many of these problems, but the key to a successful test is more then getting a winner. Learn the best practices for testing, avoid common pitfalls, and let your customers decide, with their clicks, what is best for your website.

At this session you will:

  • Analyze real life examples of testing and how deceptive their results can be.
  • Learn what type of test is right for your situation.
  • Discover the steps to setup and define a test.
  • See what you need to monitor during a test.
  • The steps to evaluate the test and get meaningful results.
Photo of Kevin Tams

Kevin Tams

Extra Space Storage

Kevin Tams is Director of Web Architecture and leads the web development team with Extra Space Storage. He has been involved in the development and management of websites for the past ten years. He has been testing websites for the past four years and has run tests for start-ups, educational, non-profit, and retail companies. Kevin managed the implementation of the Google Website Workout contest for Extra Space Storage. He has experience with the major testing products.

He holds a bachelor’s degree in Business Information Systems from Utah State University, and a Masters of Information Systems Management (Techno MBA) from Brigham Young University.

  • 3Tera, Inc
  • Ascentium
  • Awareness
  • HiveLive, Inc.
  • ImageSpan
  • Jive Software
  • Juniper Networks
  • Kapow Technologies
  • Keynote Systems
  • LithiumTechnologies
  • Nokia
  • nomee
  • Qtask
  • Rackspace Hosting
  • Remy
  • TamTamy
  • Vignette
  • Yola (fka SynthaSite)
  • Znak
  • IBM
  • eBay
  • Microsoft Corporation
  • Adobe Systems, Inc.
  • EffectiveUI
  • Germany Trade & Invest
  • NeuStar
  • ONEsite

Sponsor & Exhibitor Opportunities

Natalia Dugandzic

Media Sponsor Opportunities

Matthew Balthazor

Speaker / Program Ideas

Have a suggestion for a speaker or topic at Web 2.0 Expo San Francisco? Send an email to:

Press/Media Inquiries

Maureen Jennings


Natalia Wodecki

Contact Us

View a complete list of Web 2.0 Expo contacts.