{"course":{"slug":"ai-actually-explained","title":"AI, Actually Explained","url":"https://addaly.com/learn/ai-actually-explained","level":"beginner","track":"start"},"lesson":{"slug":"why-the-hands-were-wrong","title":"Why the hands were wrong","url":"https://addaly.com/learn/ai-actually-explained/why-the-hands-were-wrong","position":55,"of":92,"minutes":8,"answer":"Hands and lettering failed because the training photographs rarely show either clearly and the text reader saw words rather than letters.","keyIdea":"Hands and lettering failed because the training photographs rarely show either clearly and the text reader saw words rather than letters, and both improved when the data and the reader changed rather than when the models got cleverer."},"body":{"format":"markdown","text":"## The two famous failures\n\nFor about eighteen months from mid-2022, you could identify a generated image in two places. The hands had six fingers, or four, or two thumbs, or a finger that merged into a cup. And any writing (a shop sign, a book cover, a T-shirt) was a plausible texture of letter-shapes that spelled nothing.\n\nBoth are gone, or mostly gone, in the models of 2024 onward. Understanding why they were there, and what fixed them, tells you more about how these systems learn than any success does.\n\n## Hands: a statistics problem\n\nThe model in this module learns what pictures look like from photographs. Think about how hands appear in photographs. They are small, usually a few per cent of the frame. They are often partly hidden, holding something, in a pocket, cut off by the edge. They take thousands of distinct poses, each of which looks different from every angle, and in most poses some fingers hide others. A face, by contrast, is large, usually shown front-on, and always has the same parts in the same arrangement.\n\nSo the model saw millions of clear faces and comparatively few clear hands, and the hands it saw did not agree with each other about how many fingers were visible. What it learned about hands was a texture: a skin-coloured region with finger-like protrusions, in an unspecified number. Asked to draw one at full size, it produced exactly that. The mechanism is the same one behind hallucination in the chatbot module (specific detail inside a familiar structure, with thin support) and the finger count was the invented specific.\n\nThe fix was not an idea about hands. It was more and better data: photographs where hands were large and clear, captions that described them, and larger models with more capacity for the rare case. A model that has seen enough clear hands learns that they usually have five fingers, in the same way it learned faces have two eyes. The improvement tracked the data, which is the honest way to say nobody taught it anatomy.\n\n## Letters: a reader problem\n\nText failed for a different reason, and the previous lesson set it up. The reader that converted the prompt into concept-positions saw the word \"OPEN\" as a single token and had no idea it was made of four letters in a particular order. The image model, meanwhile, had seen writing in photographs only as a texture (rows of letter-shaped marks) and learned to produce the texture. Neither half of the system knew what a letter was.\n\nTwo changes fixed it. Readers that see characters rather than whole words, so that the prompt \"a sign saying OPEN\" carries the letters O, P, E, N in order into the steering. And training captions that transcribed the visible text in images, so that the picture model learned that the texture of writing and the letters in the caption were the same thing. A model released in 2023 by a small company made legible text its main selling point; by 2024 the open models could do it too.\n\n## What is still wrong, and why\n\nLong text still fails. A sign with three words works; a paragraph degrades, and the mechanism is the same as counting: the model holds a few letters as steered concepts and the rest as texture. Numbers of things (six people, exactly three windows) still fail for the reason in the first lesson of this module, that the model draws a texture of the thing rather than the things. Hands in complex poses, hands holding hands, hands playing instruments still go wrong more than faces do, because those remain rare in the data.\n\n## What this teaches about all of it\n\nThe hands were the honest signal of how these models work. They did not fail because the model lacked a rule about fingers; it has no rules. They failed because the statistics of the training photographs were thin exactly there. And they were fixed by thickening the statistics, not by cleverness. When you see any generative model fail at something specific, ask where in its training the support would have to come from, and whether it was ever there. It is the same question the chatbot module taught you to ask about a citation."},"check":{"question":"Early image models drew faces well and hands badly. Why the difference?","options":[{"text":"Hands are anatomically more complex than faces, so the model needed an explicit rule about the number of fingers, which nobody had written.","correct":false,"tempting":"Assumes the model works from rules; it has none for faces either, and learned those from abundant clear examples."},{"text":"The models were trained mostly on portraits, so they had never seen a hand.","correct":false,"tempting":"Overstates the gap; hands were present in millions of images, but small, occluded and inconsistent."},{"text":"In photographs hands are small, often hidden and in thousands of poses, so the model learned a texture with an unspecified finger count.","correct":true},{"text":"The text reader could not recognise the word \"hand\" in prompts.","correct":false,"tempting":"Confuses the hands failure with the lettering failure, which was the reader's problem."}]},"prev":{"slug":"how-the-prompt-reaches-the-picture","title":"How words steer the picture","url":"https://addaly.com/learn/ai-actually-explained/how-the-prompt-reaches-the-picture"},"next":{"slug":"the-model-that-looks-at-pictures","title":"When the model looks at a picture","url":"https://addaly.com/learn/ai-actually-explained/the-model-that-looks-at-pictures"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Why the hands were wrong', in AI, Actually Explained. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-actually-explained/why-the-hands-were-wrong (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Why the hands were wrong","courseTitle":"AI, Actually Explained","module":{"index":6,"slug":"beyond-text","title":"Beyond text: pictures, voices and video"},"answer":null,"keyIdea":"Hands and lettering failed because the training photographs rarely show either clearly and the text reader saw words rather than letters, and both improved when the data and the reader changed rather than when the models got cleverer.","hero":{"kind":"plate","image":null,"alt":null,"caption":null},"blocks":[{"t":"h2","id":"the-two-famous-failures","runs":[{"text":"The two famous failures"}]},{"t":"p","runs":[{"text":"For about eighteen months from mid-2022, you could identify a generated image in two places. The hands had six fingers, or four, or two thumbs, or a finger that merged into a cup. And any writing (a shop sign, a book cover, a T-shirt) was a plausible texture of letter-shapes that spelled nothing."}]},{"t":"p","runs":[{"text":"Both are gone, or mostly gone, in the models of 2024 onward. Understanding why they were there, and what fixed them, tells you more about how these systems learn than any success does."}]},{"t":"h2","id":"hands-a-statistics-problem","runs":[{"text":"Hands: a statistics problem"}]},{"t":"p","runs":[{"text":"The model in this module learns what pictures look like from photographs. Think about how hands appear in photographs. They are small, usually a few per cent of the frame. They are often partly hidden, holding something, in a pocket, cut off by the edge. They take thousands of distinct poses, each of which looks different from every angle, and in most poses some fingers hide others. A face, by contrast, is large, usually shown front-on, and always has the same parts in the same arrangement."}]},{"t":"p","runs":[{"text":"So the model saw millions of clear faces and comparatively few clear hands, and the hands it saw did not agree with each other about how many fingers were visible. What it learned about hands was a texture: a skin-coloured region with finger-like protrusions, in an unspecified number. Asked to draw one at full size, it produced exactly that. The mechanism is the same one behind hallucination in the chatbot module (specific detail inside a familiar structure, with thin support) and the finger count was the invented specific."}]},{"t":"p","runs":[{"text":"The fix was not an idea about hands. It was more and better data: photographs where hands were large and clear, captions that described them, and larger models with more capacity for the rare case. A model that has seen enough clear hands learns that they usually have five fingers, in the same way it learned faces have two eyes. The improvement tracked the data, which is the honest way to say nobody taught it anatomy."}]},{"t":"h2","id":"letters-a-reader-problem","runs":[{"text":"Letters: a reader problem"}]},{"t":"p","runs":[{"text":"Text failed for a different reason, and the previous lesson set it up. The reader that converted the prompt into concept-positions saw the word “OPEN” as a single token and had no idea it was made of four letters in a particular order. The image model, meanwhile, had seen writing in photographs only as a texture (rows of letter-shaped marks) and learned to produce the texture. Neither half of the system knew what a letter was."}]},{"t":"p","runs":[{"text":"Two changes fixed it. Readers that see characters rather than whole words, so that the prompt “a sign saying OPEN” carries the letters O, P, E, N in order into the steering. And training captions that transcribed the visible text in images, so that the picture model learned that the texture of writing and the letters in the caption were the same thing. A model released in 2023 by a small company made legible text its main selling point; by 2024 the open models could do it too."}]},{"t":"h2","id":"what-is-still-wrong-and-why","runs":[{"text":"What is still wrong, and why"}]},{"t":"p","runs":[{"text":"Long text still fails. A sign with three words works; a paragraph degrades, and the mechanism is the same as counting: the model holds a few letters as steered concepts and the rest as texture. Numbers of things (six people, exactly three windows) still fail for the reason in the first lesson of this module, that the model draws a texture of the thing rather than the things. Hands in complex poses, hands holding hands, hands playing instruments still go wrong more than faces do, because those remain rare in the data."}]},{"t":"h2","id":"what-this-teaches-about-all-of-it","runs":[{"text":"What this teaches about all of it"}]},{"t":"p","runs":[{"text":"The hands were the honest signal of how these models work. They did not fail because the model lacked a rule about fingers; it has no rules. They failed because the statistics of the training photographs were thin exactly there. And they were fixed by thickening the statistics, not by cleverness. When you see any generative model fail at something specific, ask where in its training the support would have to come from, and whether it was ever there. It is the same question the chatbot module taught you to ask about a citation."}]}],"check":{"question":[{"text":"Early image models drew faces well and hands badly. Why the difference?"}],"options":[{"text":[{"text":"Hands are anatomically more complex than faces, so the model needed an explicit rule about the number of fingers, which nobody had written."}],"correct":false,"tempting":[{"text":"Assumes the model works from rules; it has none for faces either, and learned those from abundant clear examples."}]},{"text":[{"text":"The models were trained mostly on portraits, so they had never seen a hand."}],"correct":false,"tempting":[{"text":"Overstates the gap; hands were present in millions of images, but small, occluded and inconsistent."}]},{"text":[{"text":"In photographs hands are small, often hidden and in thousands of poses, so the model learned a texture with an unspecified finger count."}],"correct":true,"tempting":null},{"text":[{"text":"The text reader could not recognise the word “hand” in prompts."}],"correct":false,"tempting":[{"text":"Confuses the hands failure with the lettering failure, which was the reader’s problem."}]}],"order":[1,3,0,2],"why":null},"prev":{"slug":"how-the-prompt-reaches-the-picture","title":"How words steer the picture","minutes":9},"next":{"slug":"the-model-that-looks-at-pictures","title":"When the model looks at a picture","minutes":9}}}