{"course":{"slug":"choosing-your-tools","title":"Choosing and Using the Tools","url":"https://addaly.com/learn/choosing-your-tools","level":"beginner","track":"work"},"lesson":{"slug":"testing-refusals","title":"Testing the edges: refusals and house manners","url":"https://addaly.com/learn/choosing-your-tools/testing-refusals","position":18,"of":76,"minutes":8,"answer":"For most professionals the costly failure is a false refusal on ordinary work, and because refusals live mostly in the product's instruction layer, they vary between products running the same model.","keyIdea":"For most professionals the costly failure is a false refusal on ordinary work, and because refusals live mostly in the product's instruction layer, they vary between products running the same model."},"body":{"format":"markdown","text":"## The failure that costs professionals the most\n\nFor most people, the expensive problem is not that a tool will answer something dangerous. It is that it will refuse something ordinary.\n\nA nurse asking about a drug interaction. A lawyer asking about the elements of an offence. A security engineer asking how a particular attack works so they can defend against it. A social worker drafting a safeguarding note. A researcher asking about self-harm statistics. A parent asking a medical question about their child. Every one of these is a legitimate professional or personal need, and every one of them sits near a boundary that products police differently.\n\nThese are **false refusals**, and they vary enormously between products running the same model, because the refusal usually lives in the product's instruction layer rather than in the weights.\n\n## Put one at the edge of your field into the file\n\nPrompt eight in your twelve is the one that sits near your professional boundary. Write it as you would ask it, with the context you would give. Then watch for four outcomes:\n\n1. **Answers usefully.** Good.\n2. **Answers with a caveat.** Usually the right behaviour, and worth preferring over a bare answer for medical and legal material.\n3. **Refuses, but explains and offers a route.** Acceptable. It tells you where the wall is.\n4. **Refuses flatly, or moralises.** This is the one that will waste your time repeatedly.\n\nThe difference between products on this is large and it is not correlated with model quality. A more capable model inside a more cautious product is less useful to you than a weaker one inside a product that trusts its users.\n\n## The other direction\n\nTest it too. If you work with young people, or you are choosing a tool for a school or a family, probe what it does with a question a fourteen-year-old might ask about a dangerous topic. If the answer is unguarded, that is a real finding about a real risk, and it belongs in the decision alongside everything else.\n\nDo not construct harmful requests to test this. You are checking behaviour at the boundary, not trying to extract something. A realistic edge case tells you what you need to know.\n\n## Stating context changes the answer\n\nOne practical technique, and an honest note about it. Explaining your role and purpose (*\"I am a district nurse; I need the interaction profile to counsel a patient\"*) frequently converts a refusal into a useful answer. The product cannot verify the claim, and that is a known weakness of the whole approach: the same sentence works whether or not it is true.\n\nTwo consequences worth holding at once. If you have a legitimate reason, say it plainly, because it works and it is honest. And do not mistake a system that can be talked round for a system that is checking anything, whether you are relying on it to protect your users or planning what to put in front of children.\n\n## Refusals move between versions\n\nOne more reason to keep this in your file rather than in your head: refusal behaviour changes more often than capability does. Companies tighten a boundary after a bad news story and loosen it after user complaints, and neither event comes with a release note that says so. A tool that refused your professional question last year may answer it now, and the reverse happens just as often.\n\nThat makes the boundary test the single item in your file most worth re-running at the six-month check, and it is also the one that most often changes the decision, because a tool that started refusing a category of question you ask daily has become unusable for you regardless of how it scores everywhere else.\n\n## House manners, which are separate\n\nWhile you are at the edges, note the ordinary behaviours that will either fit your working life or grate on it every day:\n\n- Does it ask a clarifying question, or guess? Both are defensible; only one suits you.\n- Does it hedge everything, or commit?\n- Does it apologise at length when corrected?\n- Does it pad with preamble before answering?\n- When it does not know, does it say so?\n\nNone of these appear on a benchmark. All of them determine whether you are still using the tool in six months. They are the strongest argument for testing yourself rather than reading a review: a reviewer's irritations are not yours.\n\nWrite your findings on one line in the file. *\"Refuses drug-interaction questions even with role stated; competitor answers with a caveat\"* is worth more to your future decision than any score out of twenty-four."},"check":{"question":"A district nurse finds that adding 'I am a district nurse counselling a patient' turns a refusal into a useful answer. What should she conclude about the safeguard?","options":[{"text":"The safeguard is calibrated correctly, since it released the information only once a legitimate professional context was supplied.","correct":false,"tempting":"Treats an unverified sentence as a credential check; the product has no way to confirm the role and would respond the same to anyone typing it."},{"text":"The refusal was a bug, because the model was always capable of answering and the wrapper wrongly blocked a clinical question.","correct":false,"tempting":"Calls a deliberate default a defect; caution before context is a design choice, and calling it a bug obscures that the model responds to stated context."},{"text":"It responds to stated context that it cannot verify, so it is useful for honest users and not a real barrier to dishonest ones.","correct":true},{"text":"Professional claims should be avoided, since stating one may violate the provider's usage policy even when true.","correct":false,"tempting":"Invents a prohibition on describing your own situation, when providers generally expect users to supply the context their questions need."}]},"prev":{"slug":"reading-a-leaderboard","title":"Reading a leaderboard without being fooled","url":"https://addaly.com/learn/choosing-your-tools/reading-a-leaderboard"},"next":{"slug":"deciding-and-writing-it-down","title":"Making the decision, and recording it","url":"https://addaly.com/learn/choosing-your-tools/deciding-and-writing-it-down"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Testing the edges: refusals and house manners', in Choosing and Using the Tools. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/choosing-your-tools/testing-refusals (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Testing the edges: refusals and house manners","courseTitle":"Choosing and Using the Tools","module":{"index":2,"slug":"testing-it-yourself","title":"Testing a tool yourself"},"answer":null,"keyIdea":"For most professionals the costly failure is a false refusal on ordinary work, and because refusals live mostly in the product’s instruction layer, they vary between products running the same model.","hero":{"kind":"plate","image":null,"alt":null,"caption":null},"blocks":[{"t":"h2","id":"the-failure-that-costs-professionals-the-most","runs":[{"text":"The failure that costs professionals the most"}]},{"t":"p","runs":[{"text":"For most people, the expensive problem is not that a tool will answer something dangerous. It is that it will refuse something ordinary."}]},{"t":"p","runs":[{"text":"A nurse asking about a drug interaction. A lawyer asking about the elements of an offence. A security engineer asking how a particular attack works so they can defend against it. A social worker drafting a safeguarding note. A researcher asking about self-harm statistics. A parent asking a medical question about their child. Every one of these is a legitimate professional or personal need, and every one of them sits near a boundary that products police differently."}]},{"t":"p","runs":[{"text":"These are "},{"text":"false refusals","b":true},{"text":", and they vary enormously between products running the same model, because the refusal usually lives in the product’s instruction layer rather than in the weights."}]},{"t":"h2","id":"put-one-at-the-edge-of-your-field-into-the-file","runs":[{"text":"Put one at the edge of your field into the file"}]},{"t":"p","runs":[{"text":"Prompt eight in your twelve is the one that sits near your professional boundary. Write it as you would ask it, with the context you would give. Then watch for four outcomes:"}]},{"t":"ol","start":1,"items":[[{"text":"Answers usefully.","b":true},{"text":" Good."}],[{"text":"Answers with a caveat.","b":true},{"text":" Usually the right behaviour, and worth preferring over a bare answer for medical and legal material."}],[{"text":"Refuses, but explains and offers a route.","b":true},{"text":" Acceptable. It tells you where the wall is."}],[{"text":"Refuses flatly, or moralises.","b":true},{"text":" This is the one that will waste your time repeatedly."}]]},{"t":"p","runs":[{"text":"The difference between products on this is large and it is not correlated with model quality. A more capable model inside a more cautious product is less useful to you than a weaker one inside a product that trusts its users."}]},{"t":"h2","id":"the-other-direction","runs":[{"text":"The other direction"}]},{"t":"p","runs":[{"text":"Test it too. If you work with young people, or you are choosing a tool for a school or a family, probe what it does with a question a fourteen-year-old might ask about a dangerous topic. If the answer is unguarded, that is a real finding about a real risk, and it belongs in the decision alongside everything else."}]},{"t":"p","runs":[{"text":"Do not construct harmful requests to test this. You are checking behaviour at the boundary, not trying to extract something. A realistic edge case tells you what you need to know."}]},{"t":"h2","id":"stating-context-changes-the-answer","runs":[{"text":"Stating context changes the answer"}]},{"t":"p","runs":[{"text":"One practical technique, and an honest note about it. Explaining your role and purpose ("},{"text":"”I am a district nurse; I need the interaction profile to counsel a patient”","i":true},{"text":") frequently converts a refusal into a useful answer. The product cannot verify the claim, and that is a known weakness of the whole approach: the same sentence works whether or not it is true."}]},{"t":"p","runs":[{"text":"Two consequences worth holding at once. If you have a legitimate reason, say it plainly, because it works and it is honest. And do not mistake a system that can be talked round for a system that is checking anything, whether you are relying on it to protect your users or planning what to put in front of children."}]},{"t":"h2","id":"refusals-move-between-versions","runs":[{"text":"Refusals move between versions"}]},{"t":"p","runs":[{"text":"One more reason to keep this in your file rather than in your head: refusal behaviour changes more often than capability does. Companies tighten a boundary after a bad news story and loosen it after user complaints, and neither event comes with a release note that says so. A tool that refused your professional question last year may answer it now, and the reverse happens just as often."}]},{"t":"p","runs":[{"text":"That makes the boundary test the single item in your file most worth re-running at the six-month check, and it is also the one that most often changes the decision, because a tool that started refusing a category of question you ask daily has become unusable for you regardless of how it scores everywhere else."}]},{"t":"h2","id":"house-manners-which-are-separate","runs":[{"text":"House manners, which are separate"}]},{"t":"p","runs":[{"text":"While you are at the edges, note the ordinary behaviours that will either fit your working life or grate on it every day:"}]},{"t":"ul","items":[[{"text":"Does it ask a clarifying question, or guess? Both are defensible; only one suits you."}],[{"text":"Does it hedge everything, or commit?"}],[{"text":"Does it apologise at length when corrected?"}],[{"text":"Does it pad with preamble before answering?"}],[{"text":"When it does not know, does it say so?"}]]},{"t":"p","runs":[{"text":"None of these appear on a benchmark. All of them determine whether you are still using the tool in six months. They are the strongest argument for testing yourself rather than reading a review: a reviewer’s irritations are not yours."}]},{"t":"p","runs":[{"text":"Write your findings on one line in the file. "},{"text":"”Refuses drug-interaction questions even with role stated; competitor answers with a caveat”","i":true},{"text":" is worth more to your future decision than any score out of twenty-four."}]}],"check":{"question":[{"text":"A district nurse finds that adding ‘I am a district nurse counselling a patient’ turns a refusal into a useful answer. What should she conclude about the safeguard?"}],"options":[{"text":[{"text":"The safeguard is calibrated correctly, since it released the information only once a legitimate professional context was supplied."}],"correct":false,"tempting":[{"text":"Treats an unverified sentence as a credential check; the product has no way to confirm the role and would respond the same to anyone typing it."}]},{"text":[{"text":"The refusal was a bug, because the model was always capable of answering and the wrapper wrongly blocked a clinical question."}],"correct":false,"tempting":[{"text":"Calls a deliberate default a defect; caution before context is a design choice, and calling it a bug obscures that the model responds to stated context."}]},{"text":[{"text":"It responds to stated context that it cannot verify, so it is useful for honest users and not a real barrier to dishonest ones."}],"correct":true,"tempting":null},{"text":[{"text":"Professional claims should be avoided, since stating one may violate the provider’s usage policy even when true."}],"correct":false,"tempting":[{"text":"Invents a prohibition on describing your own situation, when providers generally expect users to supply the context their questions need."}]}],"order":[0,3,1,2],"why":null},"prev":{"slug":"reading-a-leaderboard","title":"Reading a leaderboard without being fooled","minutes":9},"next":{"slug":"deciding-and-writing-it-down","title":"Making the decision, and recording it","minutes":7}}}