{"course":{"slug":"ai-for-teachers","title":"AI for Teachers","url":"https://addaly.com/learn/ai-for-teachers","level":"beginner","track":"work"},"lesson":{"slug":"the-conversation-has-a-memory-limit","title":"The conversation has a memory limit","url":"https://addaly.com/learn/ai-for-teachers/the-conversation-has-a-memory-limit","position":5,"of":57,"minutes":8,"answer":"A model can only see a fixed window of text at once, so it holds a chapter but not a textbook and forgets the instruction you gave forty messages ago.","keyIdea":"A model can only see a fixed window of text at once, so it holds a chapter but not a textbook and forgets the instruction you gave forty messages ago; start a new chat per task and paste the material in every time."},"body":{"format":"markdown","text":"## What the model can see\n\nThe model does not have a memory the way you do. It has a window. Everything it can consider when writing its next word (your instructions, your pasted material, its own earlier answers) has to fit in that window at the same time. Anything outside it does not exist for the model.\n\nThe window is measured in tokens. A token is a piece of a word: roughly three-quarters of an English word, and often less than that for Hindi, Swahili or Arabic, which are split into more pieces. The big paid models offer windows in the range of 128,000 to a million tokens: 128,000 tokens is roughly 90,000 words, a 300-page book. Free tiers are typically given a fraction of that, and the tool does not always tell you the number.\n\nFor a teacher, the practical version is: **it can hold a chapter. It probably cannot hold a textbook.** A syllabus, a mark scheme, a class set of short answers: fine. Five past papers at once, a whole term's resources, a 200-page PDF: it will either refuse, or quietly keep only part of it.\n\n## The quiet failure\n\nThe refusal is the good outcome. The quiet failure is worse: the tool truncates. It keeps the beginning or the end, drops the middle, and answers as though it had read the lot. You asked for chapter 7 questions; chapter 7 was in the dropped part; you get confident questions on chapter 3.\n\nNothing warns you. The only defence is to give it less and check that it has what you think it has. A cheap check: \"Before you start, tell me the heading of the last section you can see.\" If it names the wrong section, the material did not fit.\n\n## Long conversations forget their beginning\n\nThe window also holds the conversation itself. Every message you send and every answer it gives takes up room. Forty exchanges into a planning session, the instruction you gave in message one (\"always use Kenyan shillings, sentences under 15 words\") has slid toward the edge of the window, and eventually out of it.\n\nSome tools handle this by silently summarising the early part, which is why the model starts \"forgetting\" your constraints and reverting to dollars and long sentences. It is not being careless. Your instruction is no longer in front of it.\n\nTwo habits fix this:\n\n1. **One task, one chat.** Worksheet in one chat; parent letter in another; misconception list in a third. Long threads drift.\n2. **Repeat the constraints when they matter.** Rather than trusting message one, paste the two lines of constraints again with the request that depends on them.\n\n## Give it the material every time\n\nBecause there is no memory between chats, the model does not remember the syllabus you pasted yesterday. Tomorrow's chat starts blank. This feels wasteful, and teachers try to work around it by keeping one enormous chat open for weeks, which produces the drift above.\n\n> Figure: Everything competing for one window. Layers, top to bottom: Stored instructions (Custom instructions, a project, a Gem. Charged to the window on every message.); What you pasted (Syllabus extract, past paper, class set of answers. A photograph costs more than the same words typed.); The conversation so far (Every message you sent and every answer it gave. This is the layer that grows.); Your current request (Nearest the end, and therefore weighted most heavily.); The answer being written (Produced word by word, and it must fit too.). All five layers occupy the same fixed space at the same time. Forty exchanges in, the conversation layer has grown until the instruction you gave first is pushed to the edge and then out. The model is not being careless; your constraint is no longer in front of it.\n\nThe better workaround is a text file on your phone with the things you paste often: your class description, the syllabus extract for this term, your standard constraints. Copy, paste, ask. Twenty seconds. Some tools offer a way to store this permanently (custom instructions, a \"project\", a \"Gem\") and a later lesson covers using those. But the plain text file works everywhere and never gets lost when a product changes.\n\n## Images and files cost more than you think\n\nA photo of a textbook page costs several hundred to a couple of thousand tokens, depending on the tool. A scanned PDF of thirty pages can be thirty images. It adds up faster than text, and it hits the free-tier limits sooner. If you can type the two paragraphs you need, do; it is cheaper and more accurate than a photograph of them.\n\n## The limitation\n\nEven inside the window, attention is not uniform. Models are measurably worse at using material buried in the middle of a long input than material at the start or end: researchers call it \"lost in the middle\". So if the one constraint that matters most is in paragraph nine of your pasted brief, move it to the top or the bottom. Where you put things changes what gets used."},"check":{"question":"A teacher pastes an entire 90-page PDF textbook into a free chatbot and asks for questions on chapter 7. The questions come back well-formed but about the wrong topic. What most likely happened?","options":[{"text":"The model does not understand PDF files properly and produced generic questions instead of reading the book.","correct":false,"tempting":"Most tools read PDFs well; the problem is size, not format: the questions were specific, just to the wrong part."},{"text":"The book was too big for the window, so only part of it was kept, and chapter 7 was not in that part.","correct":true},{"text":"The model read the whole book but preferred chapter 7 of a different edition that it had seen during training.","correct":false,"tempting":"Invents a preference; the model works from what is in front of it, and when the material is present it uses that material rather than a remembered edition."},{"text":"Free tiers cannot process uploaded files at all, so the model silently ignored the upload and guessed from the chapter number.","correct":false,"tempting":"Free tiers do accept uploads within limits; the failure is a partial read, which is exactly why the output was specific but wrong."}]},"prev":{"slug":"why-it-cannot-look-it-up","title":"Why it cannot look it up","url":"https://addaly.com/learn/ai-for-teachers/why-it-cannot-look-it-up"},"next":{"slug":"it-has-read-the-american-curriculum","title":"It has read the American curriculum","url":"https://addaly.com/learn/ai-for-teachers/it-has-read-the-american-curriculum"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'The conversation has a memory limit', in AI for Teachers. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-for-teachers/the-conversation-has-a-memory-limit (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"The conversation has a memory limit","courseTitle":"AI for Teachers","module":{"index":1,"slug":"understanding-the-machine","title":"Understanding the machine you are about to use"},"answer":null,"keyIdea":"A model can only see a fixed window of text at once, so it holds a chapter but not a textbook and forgets the instruction you gave forty messages ago; start a new chat per task and paste the material in every time.","hero":{"kind":"figure","figure":{"t":"figure","label":"Figure","figure":{"type":"stack","title":"Everything competing for one window","layers":[{"label":"Stored instructions","detail":"Custom instructions, a project, a Gem. Charged to the window on every message."},{"label":"What you pasted","detail":"Syllabus extract, past paper, class set of answers. A photograph costs more than the same words typed."},{"label":"The conversation so far","detail":"Every message you sent and every answer it gave. This is the layer that grows."},{"label":"Your current request","detail":"Nearest the end, and therefore weighted most heavily."},{"label":"The answer being written","detail":"Produced word by word, and it must fit too."}],"caption":"All five layers occupy the same fixed space at the same time. Forty exchanges in, the conversation layer has grown until the instruction you gave first is pushed to the edge and then out. The model is not being careless; your constraint is no longer in front of it."},"alt":"Figure: Everything competing for one window. Layers, top to bottom: Stored instructions (Custom instructions, a project, a Gem. Charged to the window on every message.); What you pasted (Syllabus extract, past paper, class set of answers. A photograph costs more than the same words typed.); The conversation so far (Every message you sent and every answer it gave. This is the layer that grows.); Your current request (Nearest the end, and therefore weighted most heavily.); The answer being written (Produced word by word, and it must fit too.). All five layers occupy the same fixed space at the same time. Forty exchanges in, the conversation layer has grown until the instruction you gave first is pushed to the edge and then out. The model is not being careless; your constraint is no longer in front of it."}},"blocks":[{"t":"h2","id":"what-the-model-can-see","runs":[{"text":"What the model can see"}]},{"t":"p","runs":[{"text":"The model does not have a memory the way you do. It has a window. Everything it can consider when writing its next word (your instructions, your pasted material, its own earlier answers) has to fit in that window at the same time. Anything outside it does not exist for the model."}]},{"t":"p","runs":[{"text":"The window is measured in tokens. A token is a piece of a word: roughly three-quarters of an English word, and often less than that for Hindi, Swahili or Arabic, which are split into more pieces. The big paid models offer windows in the range of 128,000 to a million tokens: 128,000 tokens is roughly 90,000 words, a 300-page book. Free tiers are typically given a fraction of that, and the tool does not always tell you the number."}]},{"t":"p","runs":[{"text":"For a teacher, the practical version is: "},{"text":"it can hold a chapter. It probably cannot hold a textbook.","b":true},{"text":" A syllabus, a mark scheme, a class set of short answers: fine. Five past papers at once, a whole term’s resources, a 200-page PDF: it will either refuse, or quietly keep only part of it."}]},{"t":"h2","id":"the-quiet-failure","runs":[{"text":"The quiet failure"}]},{"t":"p","runs":[{"text":"The refusal is the good outcome. The quiet failure is worse: the tool truncates. It keeps the beginning or the end, drops the middle, and answers as though it had read the lot. You asked for chapter 7 questions; chapter 7 was in the dropped part; you get confident questions on chapter 3."}]},{"t":"p","runs":[{"text":"Nothing warns you. The only defence is to give it less and check that it has what you think it has. A cheap check: “Before you start, tell me the heading of the last section you can see.” If it names the wrong section, the material did not fit."}]},{"t":"h2","id":"long-conversations-forget-their-beginning","runs":[{"text":"Long conversations forget their beginning"}]},{"t":"p","runs":[{"text":"The window also holds the conversation itself. Every message you send and every answer it gives takes up room. Forty exchanges into a planning session, the instruction you gave in message one (“always use Kenyan shillings, sentences under 15 words”) has slid toward the edge of the window, and eventually out of it."}]},{"t":"p","runs":[{"text":"Some tools handle this by silently summarising the early part, which is why the model starts “forgetting” your constraints and reverting to dollars and long sentences. It is not being careless. Your instruction is no longer in front of it."}]},{"t":"p","runs":[{"text":"Two habits fix this:"}]},{"t":"ol","start":1,"items":[[{"text":"One task, one chat.","b":true},{"text":" Worksheet in one chat; parent letter in another; misconception list in a third. Long threads drift."}],[{"text":"Repeat the constraints when they matter.","b":true},{"text":" Rather than trusting message one, paste the two lines of constraints again with the request that depends on them."}]]},{"t":"h2","id":"give-it-the-material-every-time","runs":[{"text":"Give it the material every time"}]},{"t":"p","runs":[{"text":"Because there is no memory between chats, the model does not remember the syllabus you pasted yesterday. Tomorrow’s chat starts blank. This feels wasteful, and teachers try to work around it by keeping one enormous chat open for weeks, which produces the drift above."}]},{"t":"p","runs":[{"text":"The better workaround is a text file on your phone with the things you paste often: your class description, the syllabus extract for this term, your standard constraints. Copy, paste, ask. Twenty seconds. Some tools offer a way to store this permanently (custom instructions, a “project”, a “Gem”) and a later lesson covers using those. But the plain text file works everywhere and never gets lost when a product changes."}]},{"t":"h2","id":"images-and-files-cost-more-than-you-think","runs":[{"text":"Images and files cost more than you think"}]},{"t":"p","runs":[{"text":"A photo of a textbook page costs several hundred to a couple of thousand tokens, depending on the tool. A scanned PDF of thirty pages can be thirty images. It adds up faster than text, and it hits the free-tier limits sooner. If you can type the two paragraphs you need, do; it is cheaper and more accurate than a photograph of them."}]},{"t":"h2","id":"the-limitation","runs":[{"text":"The limitation"}],"role":"limit"},{"t":"p","runs":[{"text":"Even inside the window, attention is not uniform. Models are measurably worse at using material buried in the middle of a long input than material at the start or end: researchers call it “lost in the middle”. So if the one constraint that matters most is in paragraph nine of your pasted brief, move it to the top or the bottom. Where you put things changes what gets used."}]}],"check":{"question":[{"text":"A teacher pastes an entire 90-page PDF textbook into a free chatbot and asks for questions on chapter 7. The questions come back well-formed but about the wrong topic. What most likely happened?"}],"options":[{"text":[{"text":"The model does not understand PDF files properly and produced generic questions instead of reading the book."}],"correct":false,"tempting":[{"text":"Most tools read PDFs well; the problem is size, not format: the questions were specific, just to the wrong part."}]},{"text":[{"text":"The book was too big for the window, so only part of it was kept, and chapter 7 was not in that part."}],"correct":true,"tempting":null},{"text":[{"text":"The model read the whole book but preferred chapter 7 of a different edition that it had seen during training."}],"correct":false,"tempting":[{"text":"Invents a preference; the model works from what is in front of it, and when the material is present it uses that material rather than a remembered edition."}]},{"text":[{"text":"Free tiers cannot process uploaded files at all, so the model silently ignored the upload and guessed from the chapter number."}],"correct":false,"tempting":[{"text":"Free tiers do accept uploads within limits; the failure is a partial read, which is exactly why the output was specific but wrong."}]}],"order":[2,3,1,0],"why":null},"prev":{"slug":"why-it-cannot-look-it-up","title":"Why it cannot look it up","minutes":8},"next":{"slug":"it-has-read-the-american-curriculum","title":"It has read the American curriculum","minutes":8}}}