How to Conduct Pop-up A/B Testing

A/B pop-up testing allows you to compare two or more pop-up versions to find the most effective option for achieving your business goals, increasing website conversions, and improving user experience.

In this article, we will talk about how to conduct pop-up A/B testing and view your results.

How to Set Up an A/B Test

You can only conduct A/B testing within one project for an already existing pop-up. Create a pop-up first, and then set up an A/B test for it.

Choose a Pop-up

To start testing an already created pop-up, click Edit.

Enable the A/B Test Option

In the upper right corner of the pop-up builder, turn on the "A/B test" toggle.

Add Test Contents

Once you enable A/B testing, you will see three additional tabs: "Content A," "Content B," and "Display conditions."

To choose a different pop-up design for the "Content B" tab, click Replace template.

Once you add pop-up test contents, click Save > Next to set your display conditions.

Select Display Conditions

You can set up display conditions for each pop-up version individually or for both.

Go to the “Display conditions” tab, and select a pop-up display condition from the drop-down list. To add several conditions, click +Add condition.

To choose different conditions for the two pop-up versions being tested, select the “Use different conditions for AB-testing” checkmark, and choose a condition for each.

Select Test Duration Conditions

Choose when you want to finish testing. There are three conditions available:

For the "By the number of views" condition, you can also choose which pop-up to consider the winner: the one that collected more views or the one that collected more leads.

Once you finish with all the settings, click Save and publish. You will get one pop-up in the project, but users will be shown its two different versions in turns until the test duration condition is triggered.

How to View the Results

Once you start your A/B test in the project, you will see a counter next to your pop-up name, where the total number of views will be displayed.

Below, you will also see a percentage indicator of how many leads and views are generated by your pop-up.

You can also view statistics and monitor your pop-up’s performance over various periods of time in the "Statistics" tab. You will see your pop-up’s total number of views, interactions, and leads, as well as the A and B versions’ performance metrics compared in percentages.

Read more: How to View Your Pop-up Statistics.

When the test duration condition is triggered, or you complete the test yourself, the winner will be selected from the two pop-up versions according to your selected criterion. It will be marked with the flag icon, meaning that this pop-up’s content and display conditions are more effective.

How to Stop an A/B Test

You can stop a test even before the selected condition is triggered. To do this, click the three dots icon > Stop testing.

Next, you can delete your test. To do this, click the three dots icon > Delete.

Once you remove your test, you will get two separate pop-ups in your project. Then, you can set up A/B testing for each pop-up separately if you want to identify the most effective one.

Last Updated: 18.08.2023