A/B test power estimate calculator

Calculate normal-approximation power and null standardized expected difference with your own figures.

Your numbers

Use the units shown. Results update as you change valid inputs.

Use normal-approximation power and null standardized expected difference to compare changes to your inputs. The method and limits below explain the scope.

Examples

Examples

Try the starting example

Baseline conversion fraction
0.1
Treatment conversion fraction
0.12
Users per equal-sized arm
5000
Two-sided alpha
0.05
Normal-approximation power
0.891897
Null standardized expected difference
3.196014

Try another scenario

Baseline conversion fraction
0.11000000000000001
Treatment conversion fraction
0.12
Users per equal-sized arm
5000
Two-sided alpha
0.05
Normal-approximation power
0.347472
Null standardized expected difference
1.56729
Calculation method

Calculation method

Normal-approximation power

Normal alternative with pooled-null critical boundary, actual alternative variance.

Null standardized expected difference

Normal alternative with pooled-null critical boundary, actual alternative variance.

Symbols and units
a
Baseline conversion fraction
b
Treatment conversion fraction
c
Users per equal-sized arm
d
Two-sided alpha

Use the units shown. A list keeps the order in which you enter its values. The symbol ^ means “raised to the power of”.

Assumptions & limits

Assumptions & limits

  • Calculation uses the entered values and stated mathematical model; quantities must use the labelled units. Supported limits: All required fields must be finite values of the exact declared type and within displayed bounds. Lists contain1–1000 finite numbers. JSON tables are numeric rectangular rows, at most100 rows and30 columns; individual tools have stricter shape/domain constraints. Normal alternative with pooled-null critical boundary, actual alternative variance.
Are these inputs private?

These calculations run in your browser. A shared link contains the values you choose to share. Only questions submitted to the separate AI finder are sent to OpenAI.

Further reading

Method reference ↗

Background reading; this does not imply endorsement or independent review of SumFizz.

Share this page
Share this calculator

Leave unchecked to share the page without your entered values.