TUTORIAL (Enterprise): How to A/B test landing pages

Date Published: 08/30/2011
Author: Diana Urban

 

Do you have the HubSpot Basic or Professional product? Click here for your instructions on creating landing pages.

If you're a HubSpot Enterprise customer, then you'll have access to A/B testing with HubSpot's Landing pages that can help you optimize for conversions. This tutorial walks you through how to create a landing page A/B test.

10 guidelines for effective A/B testing

  1. Only conduct one test at a time - If you test an email campaign that directs to a landing page at the same time that you’re A/B testing that landing page, your results can get muddled pretty easily. How would you know which change caused the increase in leads?
  2. Test one variable at a time - In order to evaluate how effective an element on your page is, you have to isolate that variable in your A/B test. Only test one element at a time. Note that by taking the entire page as the variable, you can achieve drastic improvement.
  3. Test minor changes, too - Although it’s reasonable to think that big, sweeping changes can increase your lead generation numbers, the small details are often just as important. While creating your tests, remember that even a simple change, say, switching the image on your landing page, can drive big improvements. In fact, these sorts of changes are usually easier to measure than the bigger ones.
  4. You can A/B test the entire element - While you can certainly test a button color or a background shade, you should also consider making your entire landing page, call-to-action or email a variable. Instead of testing single design elements, such as headlines and images, design two completely different pages and test them against each other. Now you’re working on a higher level. This type of testing yields the biggest improvements, so consider starting with it before you continue your optimization with smaller tweaks.
  5. Measure as far down the funnel as possible - Sure, your A/B test might have a positive impact on your landing page conversion rate, but how about your sales numbers? A/B testing can have a significant effect on your bottom line. You may even see that a landing page that converted fewer prospects produced more sales. As you create your A/B test, consider how it affects metrics such as clickthrough rates, leads, traffic-to-lead conversion rates, and demo requests.
  6. Set up control & treatment - In any experiment, you need to keep a version of the original element you’re testing. when conducting A/B tests, set up your unaltered version as your “control:” the landing page you would normally use. from there, build variations, or “treatments:” the landing page you’ll test against your control. For example, if you are wondering whether including a testimonial on a landing page would make a difference, set up your control page with no testimonials. Then create your variation with the testimonial.
  7. Decide what you want to test - As you optimize your landing pages, there are a number of variables you can test. You don’t have to limit yourself to testing only images or text size. Look at the various elements on your marketing resources and their possible alternatives for design, wording, layout. In fact, some of the areas you can test might not be instantly recognizable. for instance, you can test different target audiences, timing, alignment between an email and a landing page, etc.
  8. Split your sample group randomly - In order to achieve conclusive results, you need to test with two or more audiences that are equal. With HubSpot, we automatically split traffic to your variations so that each variation gets a random sampling of visitors.
  9. Test at the same time - Timing plays a significant role in your marketing campaign’s results – be it time of day, day of the week, or month of the year. If you were to run test A during one month and test B a month later, you wouldn’t know whether the changed response rate was a result of the different template or the different month. A/B testing requires you to run the two or more variations at the same time. without simultaneous testing, you may be left second-guessing your results.
  10. Decide on necessary significance before testing - Before you launch your test, think about how significant your results should be in order for you to decide that the change should be made to your website or email campaign. Set the statistical significance goal for your winning variation before you start testing. 97-99% statistical significance is usually a good percentage to aim for.



1. Create a landing page

Go through the steps to create your first variation (the Control) using the normal steps for building a landing page.


2. Create a new variation

Click through to the Details for that landing page.
 

 

Then click on the Create A/B Test link in the Landing Page Actions message.
 


 

3. Choose a name for this variation



 
 

4. Edit the landing page variation to create a proper A/B test


What variables you should test

  • Offers - Experiment with the medium of the offer. You might test an eBook versus a whitepaper or video.
  • Copy - Experiment with the formatting and style of the content. You could test plain paragraphs versus bullet points or a longer block of text vs a shorter block of text.
  • Image - Try out different images to see how the conversion rate is influenced.
  • Form Fields - Should your form only request an email address or should it ask for more information? Play around with the length of the form.
  • Whole Page - The fastest way to achieve drastic results and produce a landing page that drives a lot of conversions is to test the entire page. Make iterations to the whole page that affect image placement, form length, and its copy. Once you have a statistically significant result pointing to the variation that performed better, you can continue optimizing through smaller tweaks.

 

 

You can quickly edit the other variation of the landing page using the Edit variation A button.
 


 

5. View the A/B test results

After you publish the variation, you can use the Variations link from the landing page details to view your A/B test results.
 

 

You can filter by several metrics such as Views, Submissions, Submission Rate, New Contacts, New Contacts Rate, and Customers.
 

 

You can also choose a variation as the winner of the test and stop serving up the other variation using the Choose as winner button.
 


Was the content and structure of this article helpful? (If you are running into an issue in your account or have a specific question about your setup, please contact our Support team.)  Yes  No

User-added image