Cohen kappa agreement calculator

Calculate cohen kappa and observed agreement fraction with your own figures.

Your numbers

Use the units shown. Results update as you change valid inputs.

Use cohen kappa and observed agreement fraction to compare changes to your inputs. The method and limits below explain the scope.

Examples

Examples

Try the starting example

Square rater contingency counts JSON
[[30,5,2],[4,25,3],[1,2,28]]
Cohen kappa
0.744668
Observed agreement fraction
0.83
Chance agreement fraction
0.3342

Try another scenario

Square rater contingency counts JSON
[[31,5,2],[4,25,3],[1,2,28]]
Cohen kappa
0.746979
Observed agreement fraction
0.831683
Chance agreement fraction
0.334771
Calculation method

Calculation method

Cohen kappa

Kappa=(po-pe)/(1-pe) using marginal products.

Observed agreement fraction

Kappa=(po-pe)/(1-pe) using marginal products.

Chance agreement fraction

Kappa=(po-pe)/(1-pe) using marginal products.

Symbols and units
a
Square rater contingency counts JSON

Use the units shown. A list keeps the order in which you enter its values. The symbol ^ means “raised to the power of”.

Assumptions & limits

Assumptions & limits

  • Calculation uses the entered values and stated mathematical model; quantities must use the labelled units. Supported limits: All required fields must be finite values of the exact declared type and within displayed bounds. Lists contain1–1000 finite numbers. JSON tables are numeric rectangular rows, at most100 rows and30 columns; individual tools have stricter shape/domain constraints. Kappa=(po-pe)/(1-pe) using marginal products.
Are these inputs private?

These calculations run in your browser. A shared link contains the values you choose to share. Only questions submitted to the separate AI finder are sent to OpenAI.

Further reading

Method reference ↗

Background reading; this does not imply endorsement or independent review of SumFizz.

Share this page
Share this calculator

Leave unchecked to share the page without your entered values.