{"course":{"slug":"ai-and-you","title":"AI, Safety and What Goes Wrong","url":"https://addaly.com/learn/ai-and-you","level":"beginner","track":"start"},"lesson":{"slug":"numbers-that-do-not-add-up","title":"Checking a number without looking it up","url":"https://addaly.com/learn/ai-and-you/numbers-that-do-not-add-up","position":24,"of":73,"minutes":8,"answer":"Round to one digit and a power of ten, divide by the population, check the units and the base rate: most bad numbers fail one of these in seconds.","keyIdea":"Round to one digit and a power of ten, divide by the population, check the units and the base rate: most bad numbers fail one of these in seconds, and any calculation that matters should be written as code rather than performed in prose."},"body":{"format":"markdown","text":"## The cheapest verification there is\n\nMany wrong numbers can be caught in ten seconds, without a source, using arithmetic you already have.\n\nLanguage models are unreliable with numbers in a specific way. They handle small arithmetic reasonably, degrade on multi-step calculation, and are worst at quantities where the plausible-looking answer and the correct answer differ by a factor of ten or a thousand. A wrong digit count produces text that reads perfectly.\n\n## Six checks\n\n**Order of magnitude.** Round everything to one digit and a power of ten. India's population is about 1.4 × 10⁹. A claim that a national scheme reached \"340 million households\" should stop you: at roughly 4.5 people per household there are about 300 million households in total, so the claim asserts more than universal coverage.\n\n**Per person.** Divide the aggregate by the population. A government programme costing ₹90,000 crore across 1.4 billion people is about ₹640 each. Now you know whether the number is large or is merely long.\n\n**Units and definitions.** Watts against watt-hours is the commonest error in energy writing: one is a rate, the other a quantity, and confusing them makes a claim meaningless. Similarly: revenue against profit, users against accounts, cases against deaths, crore against million, gross against net. When a number seems surprising, suspect the unit before suspecting the world.\n\n**Percentage against percentage point.** A rise from 2% to 3% is a one percentage point rise and a 50% increase. Both are correct and they sound completely different, which is why the choice between them is a standard persuasive move.\n\n**Base rate.** A test that is \"99% accurate\" for a condition affecting 1 in 10,000 people produces, in a million tests, about 100 true positives and about 10,000 false ones. Ninety-nine per cent of the positives are wrong. This arithmetic is behind an enormous share of bad decisions about screening, fraud detection and face recognition, and it takes one minute on the back of an envelope.\n\n**Consistency inside the passage.** Do the parts sum to the whole? Does the growth rate reproduce the end figure from the start figure? Does the total across categories match the stated total? Fabricated tables very often fail this, because each number was generated to look right individually.\n\n## A worked case\n\nSuppose a model tells you: \"The plant produces 500 megawatts and supplies electricity to 2 million homes.\"\n\n500 MW running continuously for a year is 500 × 8,760 hours, which is 4.38 million megawatt-hours, or 4.38 billion kilowatt-hours. Divide by 2 million homes: about 2,190 kWh per home per year. That is a plausible figure for a European or Indian urban household and low for a US one, and the plant will not run continuously, so the real capacity factor pulls it down by a third or more. So the claim is roughly right for some countries and optimistic for others.\n\nNotice what happened: you did not verify the claim, you established the range in which it could be true. That is usually enough to decide whether to spend twenty minutes finding the real figure.\n\n## Making the model do it properly\n\nIf a calculation matters, do not ask a language model to perform it in prose. Ask it to write the calculation and run it. Every serious assistant can produce a few lines of Python, and Python is free, exact, and available in your browser through any notebook service, or on your machine with one install.\n\n```python\nhours = 8760\nmw = 500\ncapacity_factor = 0.55\nkwh = mw * 1000 * hours * capacity_factor\nprint(kwh / 2_000_000)   # kWh per home per year\n```\n\nCode is checkable in a way that prose arithmetic is not: you can read the formula and see whether it is the right formula, which is a different and easier task than checking whether a stated result is right.\n\nThe general rule: use the model for the setup, never for the sum. It is good at knowing that annual energy is capacity times hours times capacity factor. It is unreliable at multiplying them."},"check":{"question":"A screening tool is described as \"99% accurate\" for a condition present in 1 in 10,000 people. Applied to a million people, roughly what proportion of its positive results will be wrong?","options":[{"text":"About 1%, since the tool is wrong 1% of the time on everyone it tests","correct":false,"tempting":"Applies the error rate straight to the positives. The 1% is over all tests, and almost all tests are of people without the condition."},{"text":"About 50%, since false and true positives roughly balance in screening","correct":false,"tempting":"A familiar-sounding halfway figure, with no counting behind it. The answer depends on how rare the condition is."},{"text":"It cannot be estimated without the sensitivity and specificity given separately","correct":false,"tempting":"The two rates can differ, but one 99% figure applied to both still gives the scale, and refusing to estimate loses the check."},{"text":"About 99%: roughly 10,000 false positives against roughly 100 true ones","correct":true}],"why":"A million tests at 1% error gives about 10,000 false alarms. Only about 100 people have the condition."},"prev":{"slug":"the-second-source-habit","title":"How professional checkers actually work","url":"https://addaly.com/learn/ai-and-you/the-second-source-habit"},"next":{"slug":"when-you-are-the-expert","title":"The competence inversion","url":"https://addaly.com/learn/ai-and-you/when-you-are-the-expert"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Source and assessment review continues. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Checking a number without looking it up', in AI, Safety and What Goes Wrong. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-and-you/numbers-that-do-not-add-up (Accessed: 21 November 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Checking a number without looking it up","courseTitle":"AI, Safety and What Goes Wrong","module":{"index":3,"slug":"truth-and-verification","title":"Truth, sources and verification"},"answer":null,"keyIdea":"Round to one digit and a power of ten, divide by the population, check the units and the base rate: most bad numbers fail one of these in seconds, and any calculation that matters should be written as code rather than performed in prose.","hero":{"kind":"plate","image":null,"alt":null,"caption":null},"blocks":[{"t":"h2","id":"the-cheapest-verification-there-is","runs":[{"text":"The cheapest verification there is"}]},{"t":"p","runs":[{"text":"Many wrong numbers can be caught in ten seconds, without a source, using arithmetic you already have."}]},{"t":"p","runs":[{"text":"Language models are unreliable with numbers in a specific way. They handle small arithmetic reasonably, degrade on multi-step calculation, and are worst at quantities where the plausible-looking answer and the correct answer differ by a factor of ten or a thousand. A wrong digit count produces text that reads perfectly."}]},{"t":"h2","id":"six-checks","runs":[{"text":"Six checks"}]},{"t":"p","runs":[{"text":"Order of magnitude.","b":true},{"text":" Round everything to one digit and a power of ten. India’s population is about 1.4 × 10⁹. A claim that a national scheme reached “340 million households” should stop you: at roughly 4.5 people per household there are about 300 million households in total, so the claim asserts more than universal coverage."}]},{"t":"p","runs":[{"text":"Per person.","b":true},{"text":" Divide the aggregate by the population. A government programme costing ₹90,000 crore across 1.4 billion people is about ₹640 each. Now you know whether the number is large or is merely long."}]},{"t":"p","runs":[{"text":"Units and definitions.","b":true},{"text":" Watts against watt-hours is the commonest error in energy writing: one is a rate, the other a quantity, and confusing them makes a claim meaningless. Similarly: revenue against profit, users against accounts, cases against deaths, crore against million, gross against net. When a number seems surprising, suspect the unit before suspecting the world."}]},{"t":"p","runs":[{"text":"Percentage against percentage point.","b":true},{"text":" A rise from 2% to 3% is a one percentage point rise and a 50% increase. Both are correct and they sound completely different, which is why the choice between them is a standard persuasive move."}]},{"t":"p","runs":[{"text":"Base rate.","b":true},{"text":" A test that is “99% accurate” for a condition affecting 1 in 10,000 people produces, in a million tests, about 100 true positives and about 10,000 false ones. Ninety-nine per cent of the positives are wrong. This arithmetic is behind an enormous share of bad decisions about screening, fraud detection and face recognition, and it takes one minute on the back of an envelope."}]},{"t":"p","runs":[{"text":"Consistency inside the passage.","b":true},{"text":" Do the parts sum to the whole? Does the growth rate reproduce the end figure from the start figure? Does the total across categories match the stated total? Fabricated tables very often fail this, because each number was generated to look right individually."}]},{"t":"h2","id":"a-worked-case","runs":[{"text":"A worked case"}]},{"t":"p","runs":[{"text":"Suppose a model tells you: “The plant produces 500 megawatts and supplies electricity to 2 million homes.”"}]},{"t":"p","runs":[{"text":"500 MW running continuously for a year is 500 × 8,760 hours, which is 4.38 million megawatt-hours, or 4.38 billion kilowatt-hours. Divide by 2 million homes: about 2,190 kWh per home per year. That is a plausible figure for a European or Indian urban household and low for a US one, and the plant will not run continuously, so the real capacity factor pulls it down by a third or more. So the claim is roughly right for some countries and optimistic for others."}]},{"t":"p","runs":[{"text":"Notice what happened: you did not verify the claim, you established the range in which it could be true. That is usually enough to decide whether to spend twenty minutes finding the real figure."}]},{"t":"h2","id":"making-the-model-do-it-properly","runs":[{"text":"Making the model do it properly"}]},{"t":"p","runs":[{"text":"If a calculation matters, do not ask a language model to perform it in prose. Ask it to write the calculation and run it. Every serious assistant can produce a few lines of Python, and Python is free, exact, and available in your browser through any notebook service, or on your machine with one install."}]},{"t":"code","lang":"python","label":"Python","text":"hours = 8760\nmw = 500\ncapacity_factor = 0.55\nkwh = mw * 1000 * hours * capacity_factor\nprint(kwh / 2_000_000)   # kWh per home per year"},{"t":"p","runs":[{"text":"Code is checkable in a way that prose arithmetic is not: you can read the formula and see whether it is the right formula, which is a different and easier task than checking whether a stated result is right."}]},{"t":"p","runs":[{"text":"The general rule: use the model for the setup, never for the sum. It is good at knowing that annual energy is capacity times hours times capacity factor. It is unreliable at multiplying them."}]}],"check":{"question":[{"text":"A screening tool is described as “99% accurate” for a condition present in 1 in 10,000 people. Applied to a million people, roughly what proportion of its positive results will be wrong?"}],"options":[{"text":[{"text":"About 1%, since the tool is wrong 1% of the time on everyone it tests"}],"correct":false,"tempting":[{"text":"Applies the error rate straight to the positives. The 1% is over all tests, and almost all tests are of people without the condition."}]},{"text":[{"text":"About 50%, since false and true positives roughly balance in screening"}],"correct":false,"tempting":[{"text":"A familiar-sounding halfway figure, with no counting behind it. The answer depends on how rare the condition is."}]},{"text":[{"text":"It cannot be estimated without the sensitivity and specificity given separately"}],"correct":false,"tempting":[{"text":"The two rates can differ, but one 99% figure applied to both still gives the scale, and refusing to estimate loses the check."}]},{"text":[{"text":"About 99%: roughly 10,000 false positives against roughly 100 true ones"}],"correct":true,"tempting":null}],"order":[2,3,1,0],"why":[{"text":"A million tests at 1% error gives about 10,000 false alarms. Only about 100 people have the condition."}]},"prev":{"slug":"the-second-source-habit","title":"How professional checkers actually work","minutes":7},"next":{"slug":"when-you-are-the-expert","title":"The competence inversion","minutes":7}}}