A/B Test Significance & Sample Size Calculator

Verify Frequentist Z-test confidence, Bayesian win probability, and minimum required sample size.

Control (A) vs Variant (B)


Minimum sample-size planner

  • Control CVR (A)
  • Variant CVR (B)
  • Relative lift
  • Z-score / p-value
  • Bayesian P(B beats A)
  • Min sample per variant (80% power)

No sign-up. Nothing you enter is stored.

Join the launch list

How the A/B significance & sample-size calculator works

  1. Enter visitors/clicks and conversions for Control (A) and Variant (B).
  2. Review relative lift, two-sided Z-score, p-value, confidence verdict, and Bayesian probability B beats A.
  3. Use the minimum sample-size estimator to plan how much traffic each variant needs before calling a winner.

Frequently asked questions

When should I call an A/B test statistically significant?

Typically at 95% confidence (two-tailed p-value < 0.05) once your planned minimum sample size per variant has been reached.

How is Bayesian win probability estimated?

It compares Beta posterior distributions for Variant A and Variant B to estimate the probability that B's true conversion rate exceeds A's.

Join the launch list

We'll tell you when the platform opens in 2027. Until then, the free tools are yours.

Join the launch list
Join the launch list