5 min read

How to do split tests for your emails the right way

Written by Andriy Boychuk
5 min read
Table of Contents

    It’s crucial to split test (aka a/b test) your emails to find the winning versions and improve conversions.

    In this video, we’re explaining step by step how to split test your emails based on your goals.

    I see the common mistake between our customers and other marketers who try to do AB testing. They do AB test, let’s say, we split the subject line. We send an email and we split that subject line: subject line A, subject line B.

    We do it for one email, second email, third email and so forth. And we like, “Okay, we have a winning version one, we have winning version two.”

    But there are no other steps. They just do it like over and over and over and over again. That’s why I decided to record this video to explain the proper way how we should do it. And by the way, I learned it at one of the seminars, the Digital Marketer Seminar in San Diego, California. And after that, we start doing it the proper way and generate better results for our clients.

    This is a snapshot of our reports. Actually, not a snapshot, but a slide from our report.

    So first, when you do split test, any kind of split test or AB test, it’s the same thing just like a different version. So for us, like, what are we testing?

    Let’s say, we are testing the open rate for emails. So, we split testing subject line. First of all, split test only one thing per task. Don’t split the subject line and then, the buttons, button color in the email, and so forth.

    Define a hypothesis

    First, you have to do the hypothesis. Let’s say, have a subject line A, subject line B, and say that subject line B should have a higher open rate because X, Y, and Z. So, you’re building a hypothesis.

    After you define a hypothesis, and please do not be lazy. Write it down in bullet points, in a short paragraph, or only one sentence, or some kind of like notes for yourself, but write it down because you will forget it. I promise you, after a few split tests, you will forget it. So, do a hypothesis.

    Make a conclusion

    Second, have it run for one week, two weeks, one month. Depends what, what are you testing. Pick your own timeline. So, after you have the results, review the results, see which version is like one.

    Let’s say, we thought that from the subject line B will be, we’ll have a higher open rate, but it didn’t. Subject line A have a higher open rate, so let’s create a conclusion of why. Try to understand your audience why subject line A had a higher open rate.

    Optimization

    What will you do next? And next, you should split test again. And repeat this process again and again and again and again. So, this is what’s called optimization. You have to constantly optimize.

    Like, let’s say you have a good open rate, optimize to have it even better and so forth, so just move on.

    So, this was a quick video explanation of how to do proper split testing. In case you have questions about this video or any other videos, please let us know in the comments.

    Talk email strategy with an expert