Examples
Examples
Try the starting example
- Operand A
- 1.25
- Operand B
- 0.3
- Operation: 0 add; 1 subtract; 2 multiply
- 2
- Signed magnitude integer bits
- 3
- Fractional bits
- 4
- Overflow: 0 reject; 1 saturate
- 1
- Quantized arithmetic result
- 0.375
- Encoded result bits
- 00000110
- Error against original real operation
- 0
Try another scenario
- Operand A
- 1.25
- Operand B
- 0.6
- Operation: 0 add; 1 subtract; 2 multiply
- 2
- Signed magnitude integer bits
- 3
- Fractional bits
- 4
- Overflow: 0 reject; 1 saturate
- 1
- Quantized arithmetic result
- 0.8125
- Encoded result bits
- 00001101
- Error against original real operation
- 0.0625
Calculation method
Calculation method
Quantized arithmetic result
Quantize operands and result half away from zero in signed two-complement fixed point.
Encoded result bits
Unsigned binary representation of saturated or validated signed raw integer.
Error against original real operation
Fixed result minus operation on original input operands.
Symbols and units
- a
- Operand A
- b
- Operand B
- c
- Operation: 0 add; 1 subtract; 2 multiply
- d
- Signed magnitude integer bits
- e
- Fractional bits
- f
- Overflow: 0 reject; 1 saturate
Use the units shown. A list keeps the order in which you enter its values. The symbol ^ means “raised to the power of”.
Assumptions & limits
Assumptions & limits
- Operands, formats, operation, rounding-saturation rules. Returns Result bits and quantization error. All coefficients and observations are user supplied; results describe only the stated mathematical model. Quantities are deterministic calculations from supplied observations and assumptions; no external data is fetched. Supported limits: Finite inputs only; numeric fields bounded as labelled. Lists and JSON records are limited to 256 entries unless a stricter tool bound is stated. No automatic design approval, legal conclusion, treatment recommendation or safety certification. Operand A: minimum None, maximum 1000000000000.0. Operand B: minimum None, maximum 1000000000000.0. Operation: 0 add; 1 subtract; 2 multiply: minimum 0, maximum 2. Signed magnitude integer bits: minimum 0, maximum 20. Fractional bits: minimum 0, maximum 20. Overflow: 0 reject; 1 saturate: minimum 0, maximum 1.
Are these inputs private?
These calculations run in your browser. A shared link contains the values you choose to share. Only questions submitted to the separate AI finder are sent to OpenAI.