{"course":{"slug":"ai-for-students","title":"AI for Students","url":"https://addaly.com/learn/ai-for-students","level":"beginner","track":"work"},"lesson":{"slug":"proving-it-to-yourself","title":"Proving it to yourself","url":"https://addaly.com/learn/ai-for-students/proving-it-to-yourself","position":28,"of":73,"minutes":8,"answer":"Predict your score before you check it, and record specific failures rather than grades: the average gap between what you predict and what you get is the most useful number you can have about yourself.","keyIdea":"Predict your score before you check it, and record specific failures rather than grades: the average gap between what you predict and what you get is the most useful number you can have about yourself."},"body":{"format":"markdown","text":"## The only test that counts\n\nEvery technique in this module points at one question, and it is worth stating plainly, because it is the thing the tools make easy to avoid:\n\n> With everything closed, can I do it?\n\nNot recognise it. Not follow it. Not feel that I could. Do it (produce the derivation, write the paragraph, name the mechanism, solve the problem) on blank paper, with no window open and nobody to ask.\n\nEverything else in study is instrumental to that. And it is measurable, cheaply, at any moment.\n\n## The unaided check\n\nThe procedure takes ten minutes and belongs at the end of every topic, not the end of the term.\n\n1. Close everything. Phone in another room, not face down on the desk.\n2. Set a timer for the length the real task would take.\n3. Do the thing. A past-paper question, a paragraph of the essay, a derivation, an explanation.\n4. Only then open the source and mark it honestly against the mark scheme if there is one.\n5. Write down the specific failure, not a grade. Not *weak on kinetics* but *could not remember whether the inhibitor changes Km or Vmax and guessed*.\n\nStep five is where the value is. A grade tells you how you did. A specific failure tells you what to do on Wednesday.\n\n## The calibration column\n\nBefore you check, predict your score. Write the number down.\n\nOver a term this produces the most useful single statistic you can have about yourself: the average gap between predicted and actual. If you consistently over-predict by 15 per cent, you now know that your sense of preparedness runs 15 per cent hot, and you can correct for it, which is worth more than any individual mark, because it tells you when to stop revising a topic and when you were wrong to.\n\n> Figure: The gap between what you predict and what you get. Line chart of Mark on the unaided check (%) against Week of term: Predicted before marking (2, 78) (4, 80) (6, 75) (8, 79) (10, 74) (12, 76); Actual (2, 55) (4, 61) (6, 58) (8, 67) (10, 66) (12, 71). One student's calibration column across a term: the predicted mark written down before marking, against the mark. The average gap, here about fourteen points narrowing to five, is the most useful single number anybody can hold about themselves, because it says how much to discount your own sense of being ready. Students leaning hardest on an assistant tend to over-predict most, which is the fluency trap showing up as arithmetic.\n\nStudents using AI assistants heavily tend to over-predict more, for the reason in the fluency lesson. Measuring your own gap is how you find out whether that describes you, rather than assuming it does or does not.\n\n## Building a portfolio of things you can do\n\nKeep a single file, appended to after each unaided check. One line each: the date, the task, and whether you completed it unaided.\n\n> 12 Oct: derived the quadratic formula by completing the square, unaided, 6 min.\n> 14 Oct: could not reproduce the proof that root 2 is irrational without a hint. Retry 17 Oct.\n> 17 Oct: reproduced it unaided.\n\nBy the end of a module this file is a list of demonstrated capabilities with dates. It is the answer to *what have I actually learned*, and it is immune to the feeling of competence, because it records outcomes rather than impressions.\n\nIt is also, if you ever need one, an extraordinarily good piece of evidence in an academic-integrity conversation: a dated record of you building capability under your own steam. Module 7 returns to this.\n\n## The failure this catches early\n\nThe pattern to fear is: an excellent term of assisted work, high coursework marks, a comfortable sense of understanding, and then a closed exam where none of it is available. By the time that gap appears in an exam hall it is far too late to close.\n\nThe unaided check finds it in week three, when it costs an afternoon to fix. It is a smoke alarm, and like a smoke alarm its value is entirely in going off before the thing you were worried about.\n\n## Raising the difficulty deliberately\n\nOnce a check is comfortable, make it harder in the direction the real test will:\n\n- **No notes** if you had notes.\n- **Timed** if it was untimed.\n- **Handwritten** if the exam is handwritten. Writing by hand is slower and more effortful than typing, and if you have not practised it, you will run out of time on material you knew.\n- **Cold**: a topic from three weeks ago, unannounced, rather than the one you just revised.\n- **Explained aloud** to somebody, if any part of your assessment involves speaking.\n\nEach of these narrows the gap between the conditions you practise in and the conditions you will be assessed in, which is the whole subject of Module 8.\n\n## The honest closing note\n\nThis is the least enjoyable lesson in the module to act on. Nothing about the unaided check is pleasant: you sit down knowing you might not be able to do it, and quite often you cannot. The assisted alternative is right there, and it feels better, and it produces a document.\n\nBut the question at the top of this lesson is the one the world will eventually ask, in an exam hall or a job or the first time something goes wrong and nobody is available. The students who came through this era able to do things are the ones who kept asking it of themselves, early, while it was still cheap to answer badly."},"check":{"question":"Why is writing down a predicted score before marking an unaided check more useful than the mark itself?","options":[{"text":"Because it commits you to a target, and committed targets improve subsequent performance through goal-setting effects.","correct":false,"tempting":"Reads the prediction as a goal rather than an estimate; the point is measurement of judgement, not motivation."},{"text":"Because it reduces the disappointment of a low mark by managing expectations in advance.","correct":false,"tempting":"Treats a diagnostic instrument as emotional preparation, and would work equally well with a deliberately pessimistic guess, which would destroy the measurement."},{"text":"Because predicting first prevents the mark scheme from anchoring your judgement of your own answer, which would inflate your self-assessment.","correct":false,"tempting":"Names a genuine anchoring risk in step four, but the prediction's value persists even when a marker, not the student, does the marking."},{"text":"Because the gap between prediction and result measures how far your sense of preparedness can be trusted.","correct":true}]},"prev":{"slug":"study-groups-and-peer-explanation","title":"Study groups, with and without the machine","url":"https://addaly.com/learn/ai-for-students/study-groups-and-peer-explanation"},"next":{"slug":"maths-and-arithmetic","title":"Maths, and the arithmetic problem","url":"https://addaly.com/learn/ai-for-students/maths-and-arithmetic"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Proving it to yourself', in AI for Students. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-for-students/proving-it-to-yourself (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Proving it to yourself","courseTitle":"AI for Students","module":{"index":3,"slug":"study-that-raises-difficulty","title":"Study that raises the difficulty"},"answer":null,"keyIdea":"Predict your score before you check it, and record specific failures rather than grades: the average gap between what you predict and what you get is the most useful number you can have about yourself.","hero":{"kind":"figure","figure":{"t":"figure","label":"Figure","figure":{"type":"line","title":"The gap between what you predict and what you get","series":[{"label":"Predicted before marking","points":[[2,78],[4,80],[6,75],[8,79],[10,74],[12,76]]},{"label":"Actual","points":[[2,55],[4,61],[6,58],[8,67],[10,66],[12,71]]}],"xLabel":"Week of term","yLabel":"Mark on the unaided check (%)","caption":"One student’s calibration column across a term: the predicted mark written down before marking, against the mark. The average gap, here about fourteen points narrowing to five, is the most useful single number anybody can hold about themselves, because it says how much to discount your own sense of being ready. Students leaning hardest on an assistant tend to over-predict most, which is the fluency trap showing up as arithmetic."},"alt":"Figure: The gap between what you predict and what you get. Line chart of Mark on the unaided check (%) against Week of term: Predicted before marking (2, 78) (4, 80) (6, 75) (8, 79) (10, 74) (12, 76); Actual (2, 55) (4, 61) (6, 58) (8, 67) (10, 66) (12, 71). One student’s calibration column across a term: the predicted mark written down before marking, against the mark. The average gap, here about fourteen points narrowing to five, is the most useful single number anybody can hold about themselves, because it says how much to discount your own sense of being ready. Students leaning hardest on an assistant tend to over-predict most, which is the fluency trap showing up as arithmetic."}},"blocks":[{"t":"h2","id":"the-only-test-that-counts","runs":[{"text":"The only test that counts"}]},{"t":"p","runs":[{"text":"Every technique in this module points at one question, and it is worth stating plainly, because it is the thing the tools make easy to avoid:"}]},{"t":"quote","runs":[{"text":"With everything closed, can I do it?"}]},{"t":"p","runs":[{"text":"Not recognise it. Not follow it. Not feel that I could. Do it (produce the derivation, write the paragraph, name the mechanism, solve the problem) on blank paper, with no window open and nobody to ask."}]},{"t":"p","runs":[{"text":"Everything else in study is instrumental to that. And it is measurable, cheaply, at any moment."}]},{"t":"h2","id":"the-unaided-check","runs":[{"text":"The unaided check"}]},{"t":"p","runs":[{"text":"The procedure takes ten minutes and belongs at the end of every topic, not the end of the term."}]},{"t":"ol","start":1,"items":[[{"text":"Close everything. Phone in another room, not face down on the desk."}],[{"text":"Set a timer for the length the real task would take."}],[{"text":"Do the thing. A past-paper question, a paragraph of the essay, a derivation, an explanation."}],[{"text":"Only then open the source and mark it honestly against the mark scheme if there is one."}],[{"text":"Write down the specific failure, not a grade. Not "},{"text":"weak on kinetics","i":true},{"text":" but "},{"text":"could not remember whether the inhibitor changes Km or Vmax and guessed","i":true},{"text":"."}]]},{"t":"p","runs":[{"text":"Step five is where the value is. A grade tells you how you did. A specific failure tells you what to do on Wednesday."}]},{"t":"h2","id":"the-calibration-column","runs":[{"text":"The calibration column"}]},{"t":"p","runs":[{"text":"Before you check, predict your score. Write the number down."}]},{"t":"p","runs":[{"text":"Over a term this produces the most useful single statistic you can have about yourself: the average gap between predicted and actual. If you consistently over-predict by 15 per cent, you now know that your sense of preparedness runs 15 per cent hot, and you can correct for it, which is worth more than any individual mark, because it tells you when to stop revising a topic and when you were wrong to."}]},{"t":"p","runs":[{"text":"Students using AI assistants heavily tend to over-predict more, for the reason in the fluency lesson. Measuring your own gap is how you find out whether that describes you, rather than assuming it does or does not."}]},{"t":"h2","id":"building-a-portfolio-of-things-you-can-do","runs":[{"text":"Building a portfolio of things you can do"}]},{"t":"p","runs":[{"text":"Keep a single file, appended to after each unaided check. One line each: the date, the task, and whether you completed it unaided."}]},{"t":"quote","runs":[{"text":"12 Oct: derived the quadratic formula by completing the square, unaided, 6 min."}]},{"t":"quote","runs":[{"text":"14 Oct: could not reproduce the proof that root 2 is irrational without a hint. Retry 17 Oct."}]},{"t":"quote","runs":[{"text":"17 Oct: reproduced it unaided."}]},{"t":"p","runs":[{"text":"By the end of a module this file is a list of demonstrated capabilities with dates. It is the answer to "},{"text":"what have I actually learned","i":true},{"text":", and it is immune to the feeling of competence, because it records outcomes rather than impressions."}]},{"t":"p","runs":[{"text":"It is also, if you ever need one, an extraordinarily good piece of evidence in an academic-integrity conversation: a dated record of you building capability under your own steam. Module 7 returns to this."}]},{"t":"h2","id":"the-failure-this-catches-early","runs":[{"text":"The failure this catches early"}]},{"t":"p","runs":[{"text":"The pattern to fear is: an excellent term of assisted work, high coursework marks, a comfortable sense of understanding, and then a closed exam where none of it is available. By the time that gap appears in an exam hall it is far too late to close."}]},{"t":"p","runs":[{"text":"The unaided check finds it in week three, when it costs an afternoon to fix. It is a smoke alarm, and like a smoke alarm its value is entirely in going off before the thing you were worried about."}]},{"t":"h2","id":"raising-the-difficulty-deliberately","runs":[{"text":"Raising the difficulty deliberately"}]},{"t":"p","runs":[{"text":"Once a check is comfortable, make it harder in the direction the real test will:"}]},{"t":"ul","items":[[{"text":"No notes","b":true},{"text":" if you had notes."}],[{"text":"Timed","b":true},{"text":" if it was untimed."}],[{"text":"Handwritten","b":true},{"text":" if the exam is handwritten. Writing by hand is slower and more effortful than typing, and if you have not practised it, you will run out of time on material you knew."}],[{"text":"Cold","b":true},{"text":": a topic from three weeks ago, unannounced, rather than the one you just revised."}],[{"text":"Explained aloud","b":true},{"text":" to somebody, if any part of your assessment involves speaking."}]]},{"t":"p","runs":[{"text":"Each of these narrows the gap between the conditions you practise in and the conditions you will be assessed in, which is the whole subject of Module 8."}]},{"t":"h2","id":"the-honest-closing-note","runs":[{"text":"The honest closing note"}]},{"t":"p","runs":[{"text":"This is the least enjoyable lesson in the module to act on. Nothing about the unaided check is pleasant: you sit down knowing you might not be able to do it, and quite often you cannot. The assisted alternative is right there, and it feels better, and it produces a document."}]},{"t":"p","runs":[{"text":"But the question at the top of this lesson is the one the world will eventually ask, in an exam hall or a job or the first time something goes wrong and nobody is available. The students who came through this era able to do things are the ones who kept asking it of themselves, early, while it was still cheap to answer badly."}]}],"check":{"question":[{"text":"Why is writing down a predicted score before marking an unaided check more useful than the mark itself?"}],"options":[{"text":[{"text":"Because it commits you to a target, and committed targets improve subsequent performance through goal-setting effects."}],"correct":false,"tempting":[{"text":"Reads the prediction as a goal rather than an estimate; the point is measurement of judgement, not motivation."}]},{"text":[{"text":"Because it reduces the disappointment of a low mark by managing expectations in advance."}],"correct":false,"tempting":[{"text":"Treats a diagnostic instrument as emotional preparation, and would work equally well with a deliberately pessimistic guess, which would destroy the measurement."}]},{"text":[{"text":"Because predicting first prevents the mark scheme from anchoring your judgement of your own answer, which would inflate your self-assessment."}],"correct":false,"tempting":[{"text":"Names a genuine anchoring risk in step four, but the prediction’s value persists even when a marker, not the student, does the marking."}]},{"text":[{"text":"Because the gap between prediction and result measures how far your sense of preparedness can be trusted."}],"correct":true,"tempting":null}],"order":[1,0,3,2],"why":null},"prev":{"slug":"study-groups-and-peer-explanation","title":"Study groups, with and without the machine","minutes":8},"next":{"slug":"maths-and-arithmetic","title":"Maths, and the arithmetic problem","minutes":9}}}