But is it statistically significant?

Label	Number of successes	Number of trials
			Remove

Interval confidence level:
Use multiple testing correction:

Add another variation or Reset page

ButIsItStatisticallySignificant.com was made by @eoin using "ABBA", an excellent A/B (split test) Calculator by Thumbtack Engineering.

"Yes" is the answer if there is a p-value less than 0.05 for at least one variation. The lower the p-value, the more confident you can be that the given variation is actually different from the baseline. Alternatively, try User Effect's great Chi-Square calculator.

You can skip the form and entering your test data directly onto the end of the URL like this: #Baseline=10,100&Variation+1=40,100

Share on Facebook