AI, Safety and What Goes WrongLesson 5 of 73

Module 1 · How these systems fail

Failure without an error message

In this lesson

  • 3 min read
  • 4 reading sections
  • Interactive activity
  • Knowledge check
  • Lesson 5 of 9 in this chapter

This chapter’s goalSort a failure into design, capability or misuse, read a benchmark or a demo for what it leaves out, and set how much checking a use needs by what it costs if wrong.

This chapter’s media

The film explains chapter ideas. The audiobook narrates the complete teaching text.

FormatEnglishहिंदी
Chapter filmWatch2:47Not available
Full audiobookNot availableNot available
Michigan Medicine: 2,552 patients with sepsis, and what the alert addedNever flagged by the model1709Flagged by the model843Flagged, and not yet giventimely antibiotics183patients with sepsisWong and colleagues, JAMA Internal Medicine, 2021. Of the sepsis patients it did flag, most hadalready had antibiotics on time. Only 183 were flagged before staff had acted.
Wong and colleagues, JAMA Internal Medicine, 2021. Of the sepsis patients it did flag, most had already had antibiotics on time. Only 183 were flagged before staff had acted.

Figure

A little at a time

Explore an idea, try it, then check what stays.

Step 1 of 7Free · no account needed
Lesson steps

A score every fifteen minutes

Epic, whose record systems run hundreds of American hospitals, supplies a model that flags patients who may be developing sepsis. It computes a score every fifteen minutes. Epic reported that the model separated sepsis from other cases with an AUC of 0.76 to 0.83. An AUC of 1 is perfect. An AUC of 0.5 is a coin toss.

In 2021 a team at Michigan Medicine checked it on their own patients: 27,697 adults across 38,455 hospital stays. They published the result in JAMA Internal Medicine.

Your place and first choices stay on this browser. Classroom credit is recorded separately.

Stuck on something?Ask Rukmini, your AI tutor

How to cite: Addaly (2026) ‘Failure without an error message’, in AI, Safety and What Goes Wrong. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-and-you/when-the-failure-is-invisible (Accessed: 21 November 2026).