{"course":{"slug":"ai-actually-explained","title":"AI, Actually Explained","url":"https://addaly.com/learn/ai-actually-explained","level":"beginner","track":"start"},"lesson":{"slug":"why-it-is-called-learning","title":"Why \"learning\" is a borrowed word","url":"https://addaly.com/learn/ai-actually-explained/why-it-is-called-learning","position":7,"of":92,"minutes":8,"answer":"Training and use are separate phases, so nothing you tell a model is learned by it: corrections live in the conversation and vanish with it.","keyIdea":"Training and use are separate phases, so nothing you tell a model is learned by it: corrections live in the conversation and vanish with it."},"body":{"format":"markdown","text":"## A word carried over from somewhere else\n\n\"Machine learning\" was coined by Arthur Samuel in 1959, describing a program that got better at draughts by playing games against itself. The word was a reasonable shorthand then and it is a reasonable shorthand now. The trouble is that everybody arriving at the subject brings human learning with them, and the two overlap less than the shared word suggests.\n\nThree differences matter in practice.\n\n## One: training and using are separate phases\n\nA person learns while doing. A model does not. There is a period of training, which happens once, on somebody's cluster of machines, over weeks, at a cost of millions. Then there is a period of use, which happens on your screen, and during which nothing is learned at all.\n\nThe file is read-only when you talk to it. That single fact explains a great deal of everyday behaviour.\n\nWhen you correct a chatbot and it says \"you are quite right, my apologies\", and the rest of the conversation is better, nothing was learned. Your correction is now sitting in the conversation, which is fed back to the model with every message, so the model can see it. Close the tab and it is gone. Open a new chat and the same mistake is waiting for you, unchanged.\n\nThis is the most useful misconception to get rid of early, because people spend real time patiently teaching a system that cannot be taught, and are then baffled that nothing stuck.\n\n**Memory features do not contradict this.** When an assistant remembers that you are a nurse in Kochi, ordinary software wrote that sentence into a store and pastes it in before your next message. It is a note on the desk, not a change in the reader. You can usually see the list and delete items from it, which is a good test: a learned thing could not be deleted from a list.\n\n## Two: the sample size is not comparable\n\nA child shown two giraffes can recognise a giraffe. A vision model needs thousands of labelled examples for the same competence, and a language model reads a quantity of text no human could get through in a thousand lifetimes: on the order of a trillion words or more.\n\nWhat models do have is patience and consistency. They will grind through a million examples without tiring or losing attention, which is valuable and not what a person does.\n\nThe gap has narrowed in one specific way worth knowing. A large model shown three examples inside your message often handles the fourth correctly. This is called **in-context learning**, and it looks like fast learning. It is not learning in the technical sense (no weight changed) but it is a real and useful behaviour, and it is why showing an example in your prompt works so much better than describing what you want.\n\n## Three: there is no learner in there\n\nWhen you learn something, you generally know you have learned it. You can say what you were confused about last week. You can tell the difference between something you know and something you are guessing.\n\nA model has none of that. Nothing in the file tracks what it knows, no part of it monitors its own reliability, and the confidence in its wording is a property of the text, not a readout of anything internal. Ask it how sure it is and you get a sentence generated the same way as every other sentence.\n\nThis is the mechanism behind confident wrongness, which has its own lesson later. Here, note only that it follows from the absence of a learner, not from a bug someone will fix.\n\n## The word is still doing useful work\n\nNone of this means the word is wrong. Something real happens in training that deserves a strong word. A model that has trained on medical text can answer questions that appear in no document it read. It generalises, and generalisation is the thing \"learning\" is trying to name.\n\nThe advice is narrow: keep the word, drop the assumptions that travel with it. Ask \"when did this system last learn anything, and who paid for it\" instead of assuming the answer is \"continuously, from me\". For nearly every product you will use, the answer is \"months ago, in a data centre, and you were not involved\".\n\n## The five-second test\n\nHere is a test you can run yourself, and it settles the question better than any explanation. Teach a chatbot something specific: a fact about your town, a correction, a preference. Confirm it has taken it. Then open a brand new conversation and ask about it.\n\nIf memory is switched off, it will be gone. That absence is the honest shape of the thing."},"check":{"question":"A teacher spends an hour correcting a chatbot's errors about the local school syllabus, and it improves steadily. The next morning, in a new chat, it repeats the original errors. What actually happened?","options":[{"text":"The corrections were learned but overwritten overnight when the provider retrained the model.","correct":false,"tempting":"Invents a nightly retraining cycle; providers retrain rarely, and a single user's corrections never enter it."},{"text":"The corrections improved answers only because they sat in that conversation's text, which the model can read; the weights were never touched.","correct":true},{"text":"The corrections were saved, but the new chat began with a different model version that had not received them.","correct":false,"tempting":"Blames version switching; the same behaviour occurs with an identical model, because nothing was stored."},{"text":"The chatbot learned the corrections but cannot access them without being reminded of the earlier conversation.","correct":false,"tempting":"Treats the loss as a retrieval problem, implying a stored memory exists that is merely unreachable."}]},"prev":{"slug":"prediction-is-the-engine","title":"Nearly all of it is prediction","url":"https://addaly.com/learn/ai-actually-explained/prediction-is-the-engine"},"next":{"slug":"pattern-or-understanding","title":"Does it understand anything? The honest answer","url":"https://addaly.com/learn/ai-actually-explained/pattern-or-understanding"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Why \"learning\" is a borrowed word', in AI, Actually Explained. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-actually-explained/why-it-is-called-learning (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Why “learning” is a borrowed word","courseTitle":"AI, Actually Explained","module":{"index":1,"slug":"what-the-word-names","title":"What this word actually names"},"answer":null,"keyIdea":"Training and use are separate phases, so nothing you tell a model is learned by it: corrections live in the conversation and vanish with it.","hero":{"kind":"plate","image":null,"alt":null,"caption":null},"blocks":[{"t":"h2","id":"a-word-carried-over-from-somewhere-else","runs":[{"text":"A word carried over from somewhere else"}]},{"t":"p","runs":[{"text":"“Machine learning” was coined by Arthur Samuel in 1959, describing a program that got better at draughts by playing games against itself. The word was a reasonable shorthand then and it is a reasonable shorthand now. The trouble is that everybody arriving at the subject brings human learning with them, and the two overlap less than the shared word suggests."}]},{"t":"p","runs":[{"text":"Three differences matter in practice."}]},{"t":"h2","id":"one-training-and-using-are-separate-phases","runs":[{"text":"One: training and using are separate phases"}]},{"t":"p","runs":[{"text":"A person learns while doing. A model does not. There is a period of training, which happens once, on somebody’s cluster of machines, over weeks, at a cost of millions. Then there is a period of use, which happens on your screen, and during which nothing is learned at all."}]},{"t":"p","runs":[{"text":"The file is read-only when you talk to it. That single fact explains a great deal of everyday behaviour."}]},{"t":"p","runs":[{"text":"When you correct a chatbot and it says “you are quite right, my apologies”, and the rest of the conversation is better, nothing was learned. Your correction is now sitting in the conversation, which is fed back to the model with every message, so the model can see it. Close the tab and it is gone. Open a new chat and the same mistake is waiting for you, unchanged."}]},{"t":"p","runs":[{"text":"This is the most useful misconception to get rid of early, because people spend real time patiently teaching a system that cannot be taught, and are then baffled that nothing stuck."}]},{"t":"p","runs":[{"text":"Memory features do not contradict this.","b":true},{"text":" When an assistant remembers that you are a nurse in Kochi, ordinary software wrote that sentence into a store and pastes it in before your next message. It is a note on the desk, not a change in the reader. You can usually see the list and delete items from it, which is a good test: a learned thing could not be deleted from a list."}]},{"t":"h2","id":"two-the-sample-size-is-not-comparable","runs":[{"text":"Two: the sample size is not comparable"}]},{"t":"p","runs":[{"text":"A child shown two giraffes can recognise a giraffe. A vision model needs thousands of labelled examples for the same competence, and a language model reads a quantity of text no human could get through in a thousand lifetimes: on the order of a trillion words or more."}]},{"t":"p","runs":[{"text":"What models do have is patience and consistency. They will grind through a million examples without tiring or losing attention, which is valuable and not what a person does."}]},{"t":"p","runs":[{"text":"The gap has narrowed in one specific way worth knowing. A large model shown three examples inside your message often handles the fourth correctly. This is called "},{"text":"in-context learning","b":true},{"text":", and it looks like fast learning. It is not learning in the technical sense (no weight changed) but it is a real and useful behaviour, and it is why showing an example in your prompt works so much better than describing what you want."}]},{"t":"h2","id":"three-there-is-no-learner-in-there","runs":[{"text":"Three: there is no learner in there"}]},{"t":"p","runs":[{"text":"When you learn something, you generally know you have learned it. You can say what you were confused about last week. You can tell the difference between something you know and something you are guessing."}]},{"t":"p","runs":[{"text":"A model has none of that. Nothing in the file tracks what it knows, no part of it monitors its own reliability, and the confidence in its wording is a property of the text, not a readout of anything internal. Ask it how sure it is and you get a sentence generated the same way as every other sentence."}]},{"t":"p","runs":[{"text":"This is the mechanism behind confident wrongness, which has its own lesson later. Here, note only that it follows from the absence of a learner, not from a bug someone will fix."}]},{"t":"h2","id":"the-word-is-still-doing-useful-work","runs":[{"text":"The word is still doing useful work"}]},{"t":"p","runs":[{"text":"None of this means the word is wrong. Something real happens in training that deserves a strong word. A model that has trained on medical text can answer questions that appear in no document it read. It generalises, and generalisation is the thing “learning” is trying to name."}]},{"t":"p","runs":[{"text":"The advice is narrow: keep the word, drop the assumptions that travel with it. Ask “when did this system last learn anything, and who paid for it” instead of assuming the answer is “continuously, from me”. For nearly every product you will use, the answer is “months ago, in a data centre, and you were not involved”."}]},{"t":"h2","id":"the-five-second-test","runs":[{"text":"The five-second test"}]},{"t":"p","runs":[{"text":"Here is a test you can run yourself, and it settles the question better than any explanation. Teach a chatbot something specific: a fact about your town, a correction, a preference. Confirm it has taken it. Then open a brand new conversation and ask about it."}]},{"t":"p","runs":[{"text":"If memory is switched off, it will be gone. That absence is the honest shape of the thing."}]}],"check":{"question":[{"text":"A teacher spends an hour correcting a chatbot’s errors about the local school syllabus, and it improves steadily. The next morning, in a new chat, it repeats the original errors. What actually happened?"}],"options":[{"text":[{"text":"The corrections were learned but overwritten overnight when the provider retrained the model."}],"correct":false,"tempting":[{"text":"Invents a nightly retraining cycle; providers retrain rarely, and a single user’s corrections never enter it."}]},{"text":[{"text":"The corrections improved answers only because they sat in that conversation’s text, which the model can read; the weights were never touched."}],"correct":true,"tempting":null},{"text":[{"text":"The corrections were saved, but the new chat began with a different model version that had not received them."}],"correct":false,"tempting":[{"text":"Blames version switching; the same behaviour occurs with an identical model, because nothing was stored."}]},{"text":[{"text":"The chatbot learned the corrections but cannot access them without being reminded of the earlier conversation."}],"correct":false,"tempting":[{"text":"Treats the loss as a retrieval problem, implying a stored memory exists that is merely unreachable."}]}],"order":[2,0,1,3],"why":null},"prev":{"slug":"prediction-is-the-engine","title":"Nearly all of it is prediction","minutes":8},"next":{"slug":"pattern-or-understanding","title":"Does it understand anything? The honest answer","minutes":9}}}