by Sophie Walsh March 25, 2016March 25, 2016 You can A/B test anything if you really want to. However, the truth is that an awful lot of tests deliver inconclusive results, or worse still don’t make much of a difference to what actually matters – the bottom line. To illustrate that, let’s take one common … Continue reading How to Run A/B Tests That Matter
by Kevin Ho March 17, 2016March 17, 2016 Did you know that only 1 out of every 8 A/B tests manage to produce significant results? And that’s at a professional level! Imagine how the statistics must look for people just getting started. There are a number of reasons why your A/B tests aren’t giving you … Continue reading 7 Reasons Why Your A/B Split Tests Aren’t Working
by James Lucas January 15, 2016January 15, 2016 Split testing in email marketing has been around as long as the channel itself. But what are the benefits of using split tests for your campaigns? Reuse the Results The best split tests are the ones where the results can be re-used over future emails to continue … Continue reading The Benefits of Using Split Tests for Your Email Campaigns
by Margot da Cunha December 4, 2015December 4, 2015 Can you remember the last time a friend or relative popped out of the woodworks to scare the bajesus out of you? That’s how I feel when I see new ad tests on the SERPs. Nerdy, yes, but PPC and SEO people who spend their days … Continue reading 3 Crazy New Ad Tests Being Spotted in the Wild
by Talia Wolf December 3, 2015December 3, 2015 A large opportunity for improvement exists in the realm of optimization. Most marketers optimize their websites and campaigns on pure intuition alone. This approach is problematic because it produces meaningless results. For instance, if you merely change the color of a button or the position of a … Continue reading Apply Emotions and Learn More from Your A/B Tests
Sean OgleOctober 27, 2015 A/B testing. You’ve probably heard and seen this term on most of the big marketing blogs. But, chances are you aren’t quite sure what it is. Until now. A/B testing is one of those tactics a blogger can do that can help dramatically increase the conversion rates on their website. That’s … Continue reading 10 Split Tests for Beginning Bloggers
Alex BirkettSeptember 14, 2015 When should you use bandit tests, and when is A/B/n testing best? Though there are some strong proponents (and opponents) of bandit testing, there are certain use cases where bandit testing may be optimal. Question is, when? First, let’s dive into bandit testing and talk a bit about the history of … Continue reading When to Run Bandit Tests Instead of A/B/n Tests
Melissa DukoSeptember 11, 2015 Unlike academic tests, A/B testing is actually fun. You can unleash your creativity by experimenting with different CTAs, tones, times, devices, and other modifiers (and there’s no pressure to score an ‘A’ either). An A/B test is essentially a split test that focuses on the effectiveness of one aspect of your … Continue reading 10 Tests That Will Revive Your PPC Campaign
Tim AshAugust 23, 2015 Let’s say your company needs to improve the product navigation experience. Your boss mentions that you’re going to develop new key ways to allow users to navigate – and you’re driving the project. To a lot of marketers, that process looks like this: Technically speaking, that has all the components of … Continue reading Website Testing Checklist: Usability Tests, User Acceptance Tests, and Split Tests Explained
Alex BirkettJuly 27, 2015 There’s a lot of controversy around one-tailed vs two-tailed testing. Articles like this lambast the shortcomings of one-tailed testing, saying that “unsophisticated users love them.” On the flip side, some articles and discussions take a more balanced approach and say there’s a time and a place for both. In fact, many … Continue reading One-Tailed vs Two-Tailed Tests (Does It Matter?)
