AI, Safety and What Goes WrongLesson 25 of 73

Module 3 · Truth, sources and verification

The competence inversion

In this lesson

  • 7 min read
  • 5 reading sections
  • Knowledge check
  • Lesson 8 of 8 in this chapter

This chapter’s goalEstimate from the shape of a question how likely a fabrication is, verify a claim at a cost proportional to the consequence of being wrong, and explain why a cited source that exists is not yet a verified claim.

This chapter’s media

The film explains chapter ideas. The audiobook narrates the complete teaching text.

FormatEnglishहिंदी
Chapter filmNot availableWatch2:37
Full audiobookNot availableNot available

A little at a time

Explore an idea, try it, then check what stays.

Step 1 of 7Free · no account needed
Lesson steps

The uncomfortable pattern

In the subject you know best, the model’s output is decent but shallow, and you can see the errors. In every other subject, it seems excellent.

Both impressions cannot be trusted, and the second one is the dangerous half.

The journalist and novelist Michael Crichton described the same effect in newspapers: you read the article about your own field, see it is riddled with mistakes, turn the page, and read the article about the Middle East with full confidence. He called it Gell-Mann amnesia. It applies to AI output with more force, because the output is fluent by construction and produced on demand in exactly the volume you asked for.

So the inversion: the model is most useful where you are competent, and most trusted where you are not. Its usefulness and your ability to check it point in the same direction, and your inclination to check points the other way.

Your place and first choices stay on this browser. Classroom credit is recorded separately.

Stuck on something?Ask Rukmini, your AI tutor

How to cite: Addaly (2026) ‘The competence inversion’, in AI, Safety and What Goes Wrong. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-and-you/when-you-are-the-expert (Accessed: 21 November 2026).