Last updated: 2026-04-18
What is Calibration?
Whether a model's stated confidence matches how often it is actually right: in a well-calibrated system, the predictions it labels 90% are correct about 90% of the time. It is a separate property from accuracy — a model can be accurate but overconfident, which is worse for automation because the confidence threshold you use to route work to a human stops meaning anything. Check it by bucketing predictions by confidence and measuring each bucket against a labelled set of your own data.
See also
← Back to the full AI agent glossary.