What do you like best?
When we used to do traditional A/B testing, we had to wait weeks or months for a test to reach significance. If a test didn’t work, then we had to go back to the drawing board and brainstorm again. This wasted a lot of time. What I love about Intellimize is that we can run an unlimited amount of tests at the same time. This has drastically sped up our testing cycles and at the same time increased the learnings that we can use in other marketing channels to help us ideate as a group more effectively.
Also, with traditional A/B testing, you always give half of your traffic to a bad variation. That’s a big pitfall. Instead, Intellimize automatically shows better performing variations more often while starving poorer performing variations of traffic. This makes it safe to test a lot of variations at once.
What do you dislike?
With A/B testing, the time to reach statistical significance was the limiter on our speed. Now the limiter on our speed is my team’s ability to ideate and create new variation ideas. While we’re going much faster than we did with A/B testing as I mentioned above, sometimes it emotionally feels like we’re behind on ideation, even though we’re already doing more.
Recommendations to others considering the product:
It would be a waste to buy Intellimize and still be stuck in the A/B testing mindset. Intellimize has evolved website testing and optimization. It’s not about testing A vs B, waiting it out for weeks or months, calling a winner, and implementing the winning variation across your whole site for all to see. It’s about testing numerous variations in tandem and letting your visitors’ behavior cause the machine to allocate traffic and put the right variations in front of the right person in the right moment to drive conversions. The best users of Intellimize are teams that are creative and have more ideas to test than A/B testing can keep up with.
What problems are you solving with the product? What benefits have you realized?
All of our offline and online marketing activities are inevitably driving visitors to our website, but the problem was that once all these visitors arrived, we were treating them all the same. Now, we use Intellimize to personalize our pages for each visitor, with the goal of converting more browsers into actual sign-ups, and making sure that our customers come back for repeat visits.
We’ve been super successful in the past 30 days alone with our Loyalty campaign, garnering a 184% increase in conversion rate and 7,433 incremental conversions! We’ve never done anything like that before. At this point, I can’t imagine hitting our aggressive goals without Intellimize.