Free tool for planning a test

A/B test sample size calculator

Don't start a test on a hunch. See how many visitors each version needs to reach statistical significance, and how long that takes. Free, with no sign-up.

Your test

Your current conversion rate before testing.

The smallest lift you care about finding (for example 10%). A smaller MDE needs much more traffic.

The chance of finding a winner if one exists. The standard is 80%.

Used to estimate how many days the test runs.

Required sample size

0

Visitors per variation

  • Estimated time to run0 Days

Zyro never calls a winner before 7 full days, and both the leading version and your original need at least 30 buyers. So plan for at least a week, even with lots of traffic.

See how Zyro tests work

Runs in your browser. Nothing is saved.

Why sample size matters

If you stop a test too early, you risk a false positive: thinking a version won when it was just luck. If you run it too long, you send shoppers to a losing version.

This calculator uses the standard formula for a test with a fixed end. You choose this number of visitors before you look at the results.

Why checking early is risky

With a fixed-end test, a version that looks like a winner on day 3 still has to wait for the full number of visitors. That can mean weeks of waiting.

Zyro shows each version's chance to beat the original as results come in. It calls a winner only when it is over 95% sure and the test has run 7 full days. The lead must also hold for 3 days in a row. Both the leading version and your original need at least 30 buyers. That makes it much harder for an early lucky streak to pick the wrong version.

Sample size, answered

What is Minimum Detectable Effect (MDE)?

MDE is the smallest improvement (lift) you want to be able to detect. Smaller lifts require much larger sample sizes to prove they aren't random noise.

Why do I need to calculate sample size upfront?

In traditional Frequentist testing, checking results before reaching the sample size increases the false positive rate. This calculator tells you the fixed horizon you must reach for valid results.

Let Zyro call the winner by fixed rules

Zyro shows each version's chance to beat the original as results come in. Every plan includes 1 live test.

Free plan. No card. Billed through Shopify. Uninstall and billing stops.