Free A/B testing tool

Did your test actually win?

Enter your visitors and conversions for each version. Zyro tells you the confidence level and whether the result is real, or just random noise.

Free plan · No credit card · No signup to use this calculator
Control (Original)
Variation B
What this tells you

A winning-looking number is often just luck.

Statistical significance tells you how surprising the gap between your Control and Variation would be if the two really performed the same. The common standard is 95% confidence: if there were no real difference, a gap this large would show up by chance less than 5% of the time. It is not the chance that your variation is better. That is a different question, and it is the one Zyro's own test results answer.

Human intuition is poor at probability. A variation can look like it is winning, for example 50 conversions against 40, when mathematically that difference could easily happen by luck. This calculator does the maths so you decide on evidence, not a hunch. The default numbers are illustrative, swap in your own.

How to use it

Three numbers in, one answer out.

Enter the visitors and conversions for your original, then the same for your variation. The confidence level updates the moment you type, and the verdict flips to Significant once you cross the 95% threshold. No formulas to remember, no spreadsheet to build.

Common questions

Significance, in plain English.

What is statistical significance?

Statistical significance tells you how unlikely the gap in conversion rates between your variations would be if they really performed the same. A common threshold is 95% confidence: if there were no real difference, a gap this large would show up by chance less than 5% of the time.

Why use a significance calculator?

Human intuition is poor at probability. A variation can look like it is winning when the gap could easily happen by luck. A calculator does the maths so you decide on evidence, not a hunch.

Keep going

Stop calculating by hand. Let Zyro run it.

Zyro splits your traffic, tracks conversions in real time, and tells you the winner in plain English, in dollars, the moment the result holds up.

Know your winner without the spreadsheet.

Start free and let Zyro test your store, call the winner, and show each shopper whatever sells best. In plain English, in dollars.

Start free
Free planNo credit cardAbout 2 minutes to set up