Examples
Examples
Try the starting example
- Signed format: 0 unsigned; 1 twos complement
- 1
- Magnitude integer bits (excludes sign)
- 7
- Fractional bits
- 8
- Minimum value
- -128
- Maximum value
- 127.996094
- Resolution
- 0.003906
- Total storage bits
- 16
Try another scenario
- Signed format: 0 unsigned; 1 twos complement
- 1
- Magnitude integer bits (excludes sign)
- 8
- Fractional bits
- 8
- Minimum value
- -256
- Maximum value
- 255.996094
- Resolution
- 0.003906
- Total storage bits
- 17
Calculation method
Calculation method
Minimum value
Signed: −2^integer bits; unsigned: 0.
Maximum value
2^integer bits−2^−fraction bits.
Resolution
2^−fraction bits.
Total storage bits
Sign bit + integer bits + fractional bits.
Symbols and units
- a
- Signed format: 0 unsigned; 1 twos complement
- b
- Magnitude integer bits (excludes sign)
- c
- Fractional bits
Use the units shown. A list keeps the order in which you enter its values. The symbol ^ means “raised to the power of”.
Assumptions & limits
Assumptions & limits
- Signedness, integer-fractional bits. Returns Range, resolution and overflow limits. All coefficients and observations are user supplied; results describe only the stated mathematical model. Quantities are deterministic calculations from supplied observations and assumptions; no external data is fetched. Supported limits: Finite inputs only; numeric fields bounded as labelled. Lists and JSON records are limited to 256 entries unless a stricter tool bound is stated. No automatic design approval, legal conclusion, treatment recommendation or safety certification. Signed format: 0 unsigned; 1 twos complement: minimum 0, maximum 1. Magnitude integer bits (excludes sign): minimum 0, maximum 30. Fractional bits: minimum 0, maximum 30.
Are these inputs private?
These calculations run in your browser. A shared link contains the values you choose to share. Only questions submitted to the separate AI finder are sent to OpenAI.