Set up multi-variate split testing (or A/B test)

Split testing is a method of conducting controlled, randomized experiments with the goal of improving a website metric, such as clicks, form completions, or purchases. The tester waits for a statistically significant difference in behavior to emerge. So, you create a campaign and one, two or more slight variations of it to check which one has a better response in terms of your clients.


In order to proceed with Split testing, we follow the following procedure:


1)We send to a test list the campaigns that we want to participate in AB testing.


2)We put the campaigns in the “Split testing” folder:

I go to Campaigns > Sent Campaigns > Emails/Postcards > Next to each Campaign I want to include, select the "Folders" icon > In the tab that opens, select "Add to split testing group".


3)I enter the “Split testing” folder. I am on the "Split test emails" page and press the "Start split test" button. The split test will be done for the campaigns that are in this folder. Therefore the folder must have the two campaigns intended for the split test.


4)The "Create a split test" page opens, fill in the details.


5)Then in Campaigns > Sent Campaigns > Emails/Postcards the campaigns have appeared with the wording next to the title "It is part of a N split test".


You go to Campaigns and then scroll down to Sent Campaigns and choose the campaign you want by clicking on the image of the folder.

Then, you move the campaign to Add to split testing group.

You find your campaigns in the split testing folder and click on Start split test

Once you click on it the following page appears. 


1. You name the campaign by writing something meaningful so that you understand what it is about.

2. You decide on the amount of receivers by percentage. The email that wins will be sent to the remaining percentage.

3. You decide on the time it will take to announce the winning email before it's sent to the remaining percentage.

4. You set the criteria, that is in terms of Open rate (amount of time it was read) or URL (times a link was clicked).

5. You have the chance to select your recipients as well.

Still need help? Contact Us Contact Us