AI, Safety and What Goes WrongLesson 20 of 73

Module 3 · Truth, sources and verification

What its confidence is worth

In this lesson

  • 8 min read
  • 6 reading sections
  • Knowledge check
  • Lesson 3 of 8 in this chapter

This chapter’s goalEstimate from the shape of a question how likely a fabrication is, verify a claim at a cost proportional to the consequence of being wrong, and explain why a cited source that exists is not yet a verified claim.

This chapter’s media

The film explains chapter ideas. The audiobook narrates the complete teaching text.

FormatEnglishहिंदी
Chapter filmNot availableWatch2:37
Full audiobookNot availableNot available

A little at a time

Explore an idea, try it, then check what stays.

Step 1 of 8Free · no account needed
Lesson steps

Two different things called confidence

When people ask whether a model “knows how sure it is”, they are running together two quantities that behave very differently.

Token probability. At each step the model produces a probability distribution over the next token. If it assigns 0.97 to one token and the rest is spread thin, the model is in a well-worn groove. If the top token has 0.21 and there are twelve near-rivals, it is improvising. This number is real, is computable, and is available through most APIs as log-probabilities.

Verbalised confidence. The sentence “I am confident this figure is correct”. This is text. It was produced by the same next-token machinery as the rest of the paragraph, shaped by what a confident-sounding answer looks like in the training data. It is only loosely related to the first quantity.

Most users only ever see the second, which is the one worth least.

Your place and first choices stay on this browser. Classroom credit is recorded separately.

Stuck on something?Ask Rukmini, your AI tutor

How to cite: Addaly (2026) ‘What its confidence is worth’, in AI, Safety and What Goes Wrong. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-and-you/calibration-and-confidence (Accessed: 21 November 2026).