When you’re doing an A/B test you want to know if you have a winner or not. Whether it’s testing if an Adwords Ads has a statistical significant higher click rate or whether a new page converts better versus the old one. You need to calculate the Statistical significance. This tool allows you to do this.
If you fill in the data in the “A” and “B “box the results will automatically show below them.
Audience
Converted
Conversion
—
Audience
Converted
Conversion
—
We don’t show the p value for the test you submitted. If the test is 95% confident then your A/B test has a significant difference. 95% confidence lever translates to a p-level below 0.05. If you’re looking at 99% confidence then your p-level value is 0.01.