A/B Test Significance & Sample Size Calculator
Verify Frequentist Z-test confidence, Bayesian win probability, and minimum required sample size.
- Control CVR (A)
- Variant CVR (B)
- Relative lift
- Z-score / p-value
- Bayesian P(B beats A)
- Min sample per variant (80% power)
No sign-up. Nothing you enter is stored.
How the A/B significance & sample-size calculator works
- Enter visitors/clicks and conversions for Control (A) and Variant (B).
- Review relative lift, two-sided Z-score, p-value, confidence verdict, and Bayesian probability B beats A.
- Use the minimum sample-size estimator to plan how much traffic each variant needs before calling a winner.
Frequently asked questions
When should I call an A/B test statistically significant?
Typically at 95% confidence (two-tailed p-value < 0.05) once your planned minimum sample size per variant has been reached.
How is Bayesian win probability estimated?
It compares Beta posterior distributions for Variant A and Variant B to estimate the probability that B's true conversion rate exceeds A's.
Join the launch list
We'll tell you when the platform opens in 2027. Until then, the free tools are yours.