Depends on how many people use your product and whether your product has an interface that is suited for A/B testing.
First off, here's a basic A/B testing example for those that are unfamiliar. You have a web site and want to test how effective your home page is. To do this, you show one home page to 50% of users (the A Group) and then show a different version to the other 50%. After a certain period of time, you can review which one performs better, usually via Google Analytics. So back to your question...
If a lot of people use your product and the interface can be A/B tested, you should definitely be A/B Testing for at least high visibility pages (like home pages). Google has been known to even A/B test shades of blue for a page. I don't think going that far is needed, but it might reveal some interesting details.
If your product doesn't have many users, A/B testing is not worth doing because the results you get won't be statistically significant. This means the stats you see may not reflect your product. Instead, they may represent biases, incomplete demographics, or even random chance.
Answered 1 year ago by Chris Sabanty
No comments yet.
