Creating an A/B Test

You can create several variations of a lightbox with the same conversion goal/KPI to learn which type of message in a lightbox leads to the best overall performance. ReSci Lead Capture's Lightbox Variation combined with our A/B Testing Wizard will allow you to easily set up a testing environment, quickly assess performance, and immediately exploit a winning formula. The article below serves as a tutorial to our A/B Testing and Lightbox Variation creation features.

Lightbox Variations

Before you create an A/B test you will first need to create one or more variations of your lightbox. To do this, login to your account and click on + Add in the variations column for the lightbox for which you wish to add a variation.

Next, you will see a modal pop over the screen that allows you to create and manage your lightbox variations. There are three options available when adding a new variation.

Variation Option 1: New Variation From Original

This will create a carbon copy of your original lightbox and add it as a variation. Once you click New Variation From Original, you will be taken to the Lightbox Management screen, and you can click on Edit under the Variations column to view and edit the lightbox variations.

Variation Option 2: New Variation From Theme

Click this option if you want to create a new variation from one of the pre-existing themes we have in our theme gallery.

Variation Option 3: New Variation From Another Lightbox

Choose this if you’d like to create a variation based on another lightbox that you’ve already created. Note that once you’ve created the variation, you can delete the original lightbox.

Variations Editor – “Primary” functionality

If you’re using variations, outside of an A/B test only one variation can run at a time. By default, the primary lightbox will be running and all variations will be paused. If you’d like to have one of the variations serve as the lightbox that remains on, click OFF in the Primary column that is in the same row as the lightbox you’d like to turn on. You will see OFF turn to ON. Finally, PUBLISH YOUR CHANGES.

Variation Editor Tips: You can use the rename functionality to rename your variations. We recommend using this feature to name variations in a way that helps you remember what the difference between each variation is. Only one variation can run at a time without A/B Testing. Make sure your lightbox is live in the lightbox section and select Edit to edit variations. Finally, select which variation (if any) you’d like as the primary variation. You must Publish before a variation will show as live in the Variations Editor. Please note that lightboxes with variations will show up highlighted in a faint yellow color in the Variations column.

A/B Testing

Once you create variations of a lightbox, you can test any two variations. This can be the original against a single variation or any variation against another variation. Note that only two revisions can test at one time. To go into the A/B Test Editor, login to ReSci Lead Capture and click on A/B Testing. Next, select A/B Tests.

You are then taken to a page that allows you to see the performance of your existing A/B Tests. To start a new test click on +New A/B Test.

Once in the Wizard, you can start a new A/B Test. Just follow the Wizard setup which requires you to:

1. Name the A/B Test.
2. Select which lightbox you would like to test. Note: Only lightboxes with variations will show up in the selectable list.
3. Pick the lightbox variations. Remember you can only test two at a time.
4. Select an impressions limit. This defaults to 500, but we recommend setting this value to at least 1500. It’s a good idea to look at historic page view data to get a good idea of what number you’d like to set.
5. Select a date range. We recommend setting a date range of at least 7 days.

If your impressions limit is complete before the date range is complete, the test will stop running. The same is also true the other way around. If your date range ends before you hit your impression limit, your A/B Test will also finish. There is also a progress bar at the top of the wizard that shows you how far you are in the setup process.

Once you’ve completed the Wizard setup, you must publish changes for the A/B Test to go live. Live A/B Tests show up with a checkmark next to them in the Live column in the A/B Test section. Otherwise, the A/B Tests are paused.

• You cannot delete lightboxes that have active A/B Tests.
• You cannot create more than one A/B Test for the same lightbox
• You can only test Design formats. If you want to test Conditions (like 3-Second Timer vs. Exit Intent) you need to use our multivariate testing features.