Long Arrow Right External Link angle-right Search Times Spinner angle-left

A/B Testing

To create an A/B test for any email, click on the email name and open the email report. 

Click on the “Add A/B Test” button at the top right of your window. 

The parent email name is displayed at the top left of your window. 

Define the percentage of contacts that will receive this variant. 

Note: The remaining percentage of contacts will receive the parent variant.

Select the appropriate metric for measuring the effect of the variations. The winner of the A/B test will be determined using this metric. 

Tip: If you are modifying the subject title, select “Read rate”. If you are modifying the email body, select “Clickthrough rate”.

Make any number of modifications to the variant, including images, headlines, calls to action, promotions, and more. 

Tip: For less prejudiced results, it is recommended to test one variable at a time.

Click on the “Apply” button to save your changes and continue editing. Click on the “Save & Close” button to save your changes and return to your list of emails. Click on the “Cancel” button to revert all changes and return to your list of emails. 

An icon will appear beside the name of the parent email. 

Note: The variant emails will not be listed in your email list. They are accessible from within the parent email’s report. Click on the parent email’s name to open its report.

To edit variant emails, click on the parent email name to open the email report. 

Click on the “Variants” tab. 

The list of parent and variant emails is displayed in the bottom of your window. 

The parent email will be indicated with a yellow “Parent” tag. The email that is currently selected for editing will be indicated with a green “Current” tag.  

Click on the name of the email that you wish to edit. The “Current” tag will be moved to the variant that you have selected. 

Click on the “Edit” button at the top right of your window. 

Make the necessary changes. 

Click on the “Apply” button to save your changes and continue editing. Click on the “Save & Close” button to save your changes and return to your list of emails. Click on the “Cancel” button to revert all changes and return to your list of emails. 

To view A/B test results, click on the parent email name to open the email report. 

Click on the “Variants” tab. 

Click on the “A/B Test Stats” button to open a bar graph comparison. 

The metrics you have selected for the test will be displayed on the bar graph. Mouseover any bar to see the exact counts and percentages. 

The winning variant will be indicated by a yellow trophy icon.