{"course":{"slug":"choosing-your-tools","title":"Choosing and Using the Tools","url":"https://addaly.com/learn/choosing-your-tools","level":"beginner","track":"work"},"lesson":{"slug":"sizes-and-tiers","title":"Small, medium, large: what the size label buys","url":"https://addaly.com/learn/choosing-your-tools/sizes-and-tiers","position":3,"of":76,"minutes":9,"answer":"Start every task on the smallest model in the family and move up only when the failures are wrong facts or broken reasoning.","keyIdea":"Start every task on the smallest model in the family and move up only when the failures are wrong facts or broken reasoning, because a fifth of failures are prompt problems and the price gap between sizes is around twentyfold."},"body":{"format":"markdown","text":"## One family, three very different tools\n\nEvery serious model family ships in at least three sizes, and the gap between them is larger than the gap between competing families at the same size. Choosing the size correctly saves more money than choosing the brand correctly, and it is the decision most people never make at all, because the chat app picks for them.\n\nThe rough shape, holding for several years now:\n\n- **The small one**: `mini`, `nano`, `flash`, `lite`, `haiku`, or an open model of 3 to 9 billion parameters. Answers in under a second. Costs somewhere between one twentieth and one thirtieth of the large one per token.\n- **The middle one**: `sonnet`, `pro`, `medium`, or an open model of 20 to 40 billion. Handles most real work.\n- **The large one**: `opus`, `ultra`, `pro` at the top of some families, or an open model of 70 billion and up. Slower, several times the price, better at exactly the tasks below.\n\n## Where the money actually goes\n\nHere is the arithmetic that makes this concrete. You have 50,000 support tickets to sort into eight categories. Each ticket plus instructions is about 600 tokens in, 20 tokens out.\n\n```\ninput tokens  = 50,000 x 600 = 30,000,000  (30M)\noutput tokens = 50,000 x  20 =  1,000,000  ( 1M)\n\nsmall model  @ $0.15 /M in, $0.60 /M out  ->  $4.50 + $0.60 =  $5.10\nlarge model  @ $3.00 /M in, $15.00 /M out ->  $90.00 + $15.00 = $105.00\n```\n\nTwenty times the price for a job where, if you test it honestly, the small model will very likely match the large one, because classification into eight known buckets is not a hard task. Those exact prices will be out of date by the time you read this. The ratio between them has been stable for years, and the ratio is what the decision turns on.\n\n## What the small one is good at\n\nNot \"simple things\". A more useful line: **tasks where the answer is already present in the input and the model only has to transform it.**\n\n- Classifying into categories you define\n- Extracting fields from a document you supply\n- Rewriting, shortening, changing tone\n- Translating between well-resourced languages\n- Formatting, tidying, converting between structures\n- Answering questions about a text you pasted\n\n## Where it falls over, and why\n\n**Knowledge it has to supply itself.** A small model has fewer parameters and therefore stores less of the world. Ask a 7B model about a mid-sized company's history or a specific clause of your country's tax code and it will produce a fluent, confidently wrong answer. It does not know that it does not know. This is the single most common way small models embarrass people.\n\n**Long instructions with several conditions.** Give a small model a prompt with seven rules and it will follow five. The failure is not random: the middle rules are the ones dropped.\n\n**Multi-step reasoning.** Anything where step three depends on getting step two right. Errors compound and the small model has no habit of checking itself.\n\n> Figure: The same 50,000-ticket job, three model sizes. Bars (US dollars for the whole job): Small: mini, flash, haiku, or an 8B open model 5.1; Middle: sonnet, pro, or a 30B open model 28; Large: opus, ultra, or a 70B open model 105. Thirty million input tokens and one million output, sorting into eight known buckets. That is transformation rather than knowledge, so the small model very likely matches the large one. The prices will date; the twentyfold ratio has held for years.\n\n**Long inputs.** Even when the window is large, quality on a 200-page document degrades much faster for a small model.\n\n## The ladder, as a working method\n\nDo not pick a size by reputation. Pick it by starting at the bottom.\n\n1. Run the task on the smallest model in the family.\n2. Look at twenty outputs yourself, not two.\n3. If they are right, stop. You are done, and you are paying a twentieth of what you might have.\n4. If they are wrong, look at *how* they are wrong before moving up. Wrong facts means move up. Ignored instructions often means rewrite the prompt instead, and the same small model then passes.\n\nThat last point saves a lot of money. A great many \"we need the big model\" conclusions are \"our prompt had seven rules in a paragraph\" and the fix was a numbered list.\n\n## The mixed setup\n\nThe version of this that professionals actually run: small model for the bulk pass, large model for the cases the small one flags as uncertain or that fall into a high-cost category. Ninety per cent of the volume goes cheap, ten per cent goes expensive, and the average price lands near the small model while the quality lands near the large one.\n\nYou can do this without any special software. Run the small model, have it output a confidence word alongside its answer, and route the low-confidence ones to a second pass by hand or by a second call. It is twenty lines of code, and it is the standard shape of production systems that people assume are running the frontier model everywhere."},"check":{"question":"A small model classifying support tickets ignores three of the seven rules in your instructions. What does that failure pattern suggest you should do first?","options":[{"text":"Move to the large model, since ignoring instructions is the clearest sign that this task exceeds what a small model can reliably handle.","correct":false,"tempting":"Treats every failure as a capability ceiling; dropped rules in a dense paragraph are usually a prompt-format problem and cost twenty times more to solve by upgrading."},{"text":"Rewrite the instructions as a numbered list and re-test the same small model, since dropped middle rules signal formatting.","correct":true},{"text":"Split the task into seven separate calls, one per rule, so the model cannot drop any of them.","correct":false,"tempting":"Solves it by multiplying cost sevenfold when a formatting change usually fixes it, and it forfeits the model's ability to weigh rules against each other."},{"text":"Accept the result, because classification is a transformation task and small models are known to be reliable at those.","correct":false,"tempting":"Takes a general rule as a guarantee; being the right class of task makes the small model a good candidate, not a verified one, and twenty outputs still have to be read."}]},"prev":{"slug":"reading-a-model-name","title":"Reading a model's name","url":"https://addaly.com/learn/choosing-your-tools/reading-a-model-name"},"next":{"slug":"thinking-modes","title":"Thinking modes, and what you pay for them","url":"https://addaly.com/learn/choosing-your-tools/thinking-modes"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Small, medium, large: what the size label buys', in Choosing and Using the Tools. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/choosing-your-tools/sizes-and-tiers (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Small, medium, large: what the size label buys","courseTitle":"Choosing and Using the Tools","module":{"index":1,"slug":"anatomy-of-a-tool","title":"What a tool is made of"},"answer":null,"keyIdea":"Start every task on the smallest model in the family and move up only when the failures are wrong facts or broken reasoning, because a fifth of failures are prompt problems and the price gap between sizes is around twentyfold.","hero":{"kind":"figure","figure":{"t":"figure","label":"Figure","figure":{"type":"bars","unit":"US dollars for the whole job","title":"The same 50,000-ticket job, three model sizes","series":[{"label":"Small: mini, flash, haiku, or an 8B open model","value":5.1,"highlight":true},{"label":"Middle: sonnet, pro, or a 30B open model","value":28},{"label":"Large: opus, ultra, or a 70B open model","value":105}],"caption":"Thirty million input tokens and one million output, sorting into eight known buckets. That is transformation rather than knowledge, so the small model very likely matches the large one. The prices will date; the twentyfold ratio has held for years."},"alt":"Figure: The same 50,000-ticket job, three model sizes. Bars (US dollars for the whole job): Small: mini, flash, haiku, or an 8B open model 5.1; Middle: sonnet, pro, or a 30B open model 28; Large: opus, ultra, or a 70B open model 105. Thirty million input tokens and one million output, sorting into eight known buckets. That is transformation rather than knowledge, so the small model very likely matches the large one. The prices will date; the twentyfold ratio has held for years."}},"blocks":[{"t":"h2","id":"one-family-three-very-different-tools","runs":[{"text":"One family, three very different tools"}]},{"t":"p","runs":[{"text":"Every serious model family ships in at least three sizes, and the gap between them is larger than the gap between competing families at the same size. Choosing the size correctly saves more money than choosing the brand correctly, and it is the decision most people never make at all, because the chat app picks for them."}]},{"t":"p","runs":[{"text":"The rough shape, holding for several years now:"}]},{"t":"ul","items":[[{"text":"The small one","b":true},{"text":": "},{"text":"mini","code":true},{"text":", "},{"text":"nano","code":true},{"text":", "},{"text":"flash","code":true},{"text":", "},{"text":"lite","code":true},{"text":", "},{"text":"haiku","code":true},{"text":", or an open model of 3 to 9 billion parameters. Answers in under a second. Costs somewhere between one twentieth and one thirtieth of the large one per token."}],[{"text":"The middle one","b":true},{"text":": "},{"text":"sonnet","code":true},{"text":", "},{"text":"pro","code":true},{"text":", "},{"text":"medium","code":true},{"text":", or an open model of 20 to 40 billion. Handles most real work."}],[{"text":"The large one","b":true},{"text":": "},{"text":"opus","code":true},{"text":", "},{"text":"ultra","code":true},{"text":", "},{"text":"pro","code":true},{"text":" at the top of some families, or an open model of 70 billion and up. Slower, several times the price, better at exactly the tasks below."}]]},{"t":"h2","id":"where-the-money-actually-goes","runs":[{"text":"Where the money actually goes"}]},{"t":"p","runs":[{"text":"Here is the arithmetic that makes this concrete. You have 50,000 support tickets to sort into eight categories. Each ticket plus instructions is about 600 tokens in, 20 tokens out."}]},{"t":"code","lang":"","label":"Text","text":"input tokens  = 50,000 x 600 = 30,000,000  (30M)\noutput tokens = 50,000 x  20 =  1,000,000  ( 1M)\n\nsmall model  @ $0.15 /M in, $0.60 /M out  ->  $4.50 + $0.60 =  $5.10\nlarge model  @ $3.00 /M in, $15.00 /M out ->  $90.00 + $15.00 = $105.00"},{"t":"p","runs":[{"text":"Twenty times the price for a job where, if you test it honestly, the small model will very likely match the large one, because classification into eight known buckets is not a hard task. Those exact prices will be out of date by the time you read this. The ratio between them has been stable for years, and the ratio is what the decision turns on."}]},{"t":"h2","id":"what-the-small-one-is-good-at","runs":[{"text":"What the small one is good at"}]},{"t":"p","runs":[{"text":"Not “simple things”. A more useful line: "},{"text":"tasks where the answer is already present in the input and the model only has to transform it.","b":true}]},{"t":"ul","items":[[{"text":"Classifying into categories you define"}],[{"text":"Extracting fields from a document you supply"}],[{"text":"Rewriting, shortening, changing tone"}],[{"text":"Translating between well-resourced languages"}],[{"text":"Formatting, tidying, converting between structures"}],[{"text":"Answering questions about a text you pasted"}]]},{"t":"h2","id":"where-it-falls-over-and-why","runs":[{"text":"Where it falls over, and why"}]},{"t":"p","runs":[{"text":"Knowledge it has to supply itself.","b":true},{"text":" A small model has fewer parameters and therefore stores less of the world. Ask a 7B model about a mid-sized company’s history or a specific clause of your country’s tax code and it will produce a fluent, confidently wrong answer. It does not know that it does not know. This is the single most common way small models embarrass people."}]},{"t":"p","runs":[{"text":"Long instructions with several conditions.","b":true},{"text":" Give a small model a prompt with seven rules and it will follow five. The failure is not random: the middle rules are the ones dropped."}]},{"t":"p","runs":[{"text":"Multi-step reasoning.","b":true},{"text":" Anything where step three depends on getting step two right. Errors compound and the small model has no habit of checking itself."}]},{"t":"p","runs":[{"text":"Long inputs.","b":true},{"text":" Even when the window is large, quality on a 200-page document degrades much faster for a small model."}]},{"t":"h2","id":"the-ladder-as-a-working-method","runs":[{"text":"The ladder, as a working method"}]},{"t":"p","runs":[{"text":"Do not pick a size by reputation. Pick it by starting at the bottom."}]},{"t":"ol","start":1,"items":[[{"text":"Run the task on the smallest model in the family."}],[{"text":"Look at twenty outputs yourself, not two."}],[{"text":"If they are right, stop. You are done, and you are paying a twentieth of what you might have."}],[{"text":"If they are wrong, look at "},{"text":"how","i":true},{"text":" they are wrong before moving up. Wrong facts means move up. Ignored instructions often means rewrite the prompt instead, and the same small model then passes."}]]},{"t":"p","runs":[{"text":"That last point saves a lot of money. A great many “we need the big model” conclusions are “our prompt had seven rules in a paragraph” and the fix was a numbered list."}]},{"t":"h2","id":"the-mixed-setup","runs":[{"text":"The mixed setup"}]},{"t":"p","runs":[{"text":"The version of this that professionals actually run: small model for the bulk pass, large model for the cases the small one flags as uncertain or that fall into a high-cost category. Ninety per cent of the volume goes cheap, ten per cent goes expensive, and the average price lands near the small model while the quality lands near the large one."}]},{"t":"p","runs":[{"text":"You can do this without any special software. Run the small model, have it output a confidence word alongside its answer, and route the low-confidence ones to a second pass by hand or by a second call. It is twenty lines of code, and it is the standard shape of production systems that people assume are running the frontier model everywhere."}]}],"check":{"question":[{"text":"A small model classifying support tickets ignores three of the seven rules in your instructions. What does that failure pattern suggest you should do first?"}],"options":[{"text":[{"text":"Move to the large model, since ignoring instructions is the clearest sign that this task exceeds what a small model can reliably handle."}],"correct":false,"tempting":[{"text":"Treats every failure as a capability ceiling; dropped rules in a dense paragraph are usually a prompt-format problem and cost twenty times more to solve by upgrading."}]},{"text":[{"text":"Rewrite the instructions as a numbered list and re-test the same small model, since dropped middle rules signal formatting."}],"correct":true,"tempting":null},{"text":[{"text":"Split the task into seven separate calls, one per rule, so the model cannot drop any of them."}],"correct":false,"tempting":[{"text":"Solves it by multiplying cost sevenfold when a formatting change usually fixes it, and it forfeits the model’s ability to weigh rules against each other."}]},{"text":[{"text":"Accept the result, because classification is a transformation task and small models are known to be reliable at those."}],"correct":false,"tempting":[{"text":"Takes a general rule as a guarantee; being the right class of task makes the small model a good candidate, not a verified one, and twenty outputs still have to be read."}]}],"order":[2,0,3,1],"why":null},"prev":{"slug":"reading-a-model-name","title":"Reading a model’s name","minutes":9},"next":{"slug":"thinking-modes","title":"Thinking modes, and what you pay for them","minutes":8}}}