Examples
Examples
Try the starting example
- Known line pixel positions
- 10,100,200,300
- Known wavelengths (nm)
- 405,450,500,550
- Polynomial degree
- 1
- Coefficients ascending pixel powers
- [400,0.5]
- Residual wavelengths (nm)
- [5.68434188608e-14,0,0,-1.13686837722e-13]
- RMS residual (nm)
- 0
Try another scenario
- Known line pixel positions
- 11.0,100.0,200.0,300.0
- Known wavelengths (nm)
- 405,450,500,550
- Polynomial degree
- 1
- Coefficients ascending pixel powers
- [399.643626144,0.501514722461]
- Residual wavelengths (nm)
- [-0.160288091129,0.204901609827,0.0534293637095,-0.0980428824078]
- RMS residual (nm)
- 0.141549
Calculation method
Calculation method
Coefficients ascending pixel powers
Ordinary least squares polynomial with QR solution, non-repeated pixels and sufficient observations.
Residual wavelengths (nm)
Ordinary least squares polynomial with QR solution, non-repeated pixels and sufficient observations.
RMS residual (nm)
Ordinary least squares polynomial with QR solution, non-repeated pixels and sufficient observations.
Symbols and units
- a
- Known line pixel positions
- b
- Known wavelengths (nm)
- c
- Polynomial degree
Use the units shown. A list keeps the order in which you enter its values. The symbol ^ means “raised to the power of”.
Assumptions & limits
Assumptions & limits
- Calibration within supplied pixel range; polynomial extrapolation not validated. Supported limits: All required fields must be finite values of the exact declared type and within displayed bounds. Lists contain1–1000 finite numbers. JSON tables are numeric rectangular rows, at most100 rows and30 columns; individual tools have stricter shape/domain constraints. Calibration within supplied pixel range; polynomial extrapolation not validated.
Are these inputs private?
These calculations run in your browser. A shared link contains the values you choose to share. Only questions submitted to the separate AI finder are sent to OpenAI.