{"course":{"slug":"ai-actually-explained","title":"AI, Actually Explained","url":"https://addaly.com/learn/ai-actually-explained","level":"beginner","track":"start"},"lesson":{"slug":"the-things-to-never-hand-it","title":"What not to hand it","url":"https://addaly.com/learn/ai-actually-explained/the-things-to-never-hand-it","position":70,"of":92,"minutes":9,"answer":"A chatbot is not a confidant, a professional or a record-keeper (it has no duty of confidentiality, no accountability and no way to know your jurisdiction) so the things to keep from it are identities.","keyIdea":"A chatbot is not a confidant, a professional or a record-keeper (it has no duty of confidentiality, no accountability and no way to know your jurisdiction) so the things to keep from it are identities, secrets, other people's data and the final word."},"body":{"format":"markdown","text":"## Three things a chatbot is not\n\nIt is not a **confidant**. A doctor, a lawyer and a priest have legal or professional duties about what you tell them. A chatbot has terms of service. In 2025 the chief executive of the largest chatbot company said in an interview that conversations with it carry no legal privilege, and that a court could require them to be produced. People, he said, tell it the most personal things and should know that.\n\nIt is not a **professional**. Nobody is accountable for its answer. A practitioner who gets it wrong can be struck off, sued or sacked, and that accountability is most of what you are paying for. The model's answer is a fluent draft with no one's name on it.\n\nIt is not a **record-keeper**. What you told it is stored under the previous lessons' rules, and what it told you is not a record of anything: ask again tomorrow and get a different answer.\n\nFrom those three follow the things to keep out of the box.\n\n## Identities and secrets\n\nYour identity documents, and anyone else's: Aadhaar, passport, PAN, driving licence. Passwords, one-time codes, card numbers, account numbers. These have no business in a system that stores text, may show it to a contractor and may train on it, and they are exactly what a scam will ask you to paste \"to verify\". No legitimate task needs a document number to rewrite a paragraph.\n\n## Other people's data\n\nThe moment you paste a colleague's medical note, a customer list, a student's essay with their name on it, or a patient's history, you have disclosed someone else's personal data to a third party. Under India's data-protection law of 2023, an organisation that does that is responsible for it, and the same is true under the European rules and most others. Strip the names. If the task needs the names, it is not a chatbot task.\n\n## Work that is not yours to share\n\nUnreleased code, contracts under negotiation, anything under a non-disclosure agreement, the client's brief. The electronics company from the earlier lesson banned the tools after its engineers pasted source code. The rule is the same one you would apply to emailing the material to a stranger who promises not to look.\n\n## Medical, legal and financial: the shape of the risk\n\nPeople use chatbots for these more than for anything else, and the honest advice is not \"never\". It is: use it to *understand* and to *prepare*, never to *decide*, and know the three mechanisms that make the decision unsafe.\n\n**It invents specifics.** Dosages, deadlines, section numbers, tax thresholds (the exact things a decision turns on) are the exact things the hallucination module told you it fabricates. In 2023 two New York lawyers filed a brief containing six cases the chatbot had made up, complete with quotations, and were fined by the court. The cases sounded exactly like cases.\n\n**It does not know where you are.** Law, tax, drug approvals and medical guidelines differ by country and by state, and the training text is weighted toward the United States. An answer that is correct in Texas can be wrong in Tamil Nadu, delivered with the same confidence.\n\n**Its knowledge stops.** Rules change; the cut-off lesson explained that the model's do not, and a search tool bolted on helps only if it finds the current rule and the model reads it correctly.\n\nSo: ask it to explain the terms in your blood-test report so that you can ask your doctor better questions. Ask it what questions a tenant should ask a lawyer. Ask it what the categories on a tax form mean. Then take the questions to the person whose name goes on the answer. That is not a failure of the tool. It is what the tool is for.\n\n## The final word\n\nThe last thing not to hand it is the decision itself. A model can lay out options, draft the letter, summarise the arguments and argue the other side. It cannot carry the consequence, and a decision made by someone who cannot carry the consequence is not a decision; it is a guess with good grammar. The next lesson is about how to keep that line when the guesses are this good."},"check":{"question":"A user pastes a colleague's medical certificate into a chatbot to reword the covering email. What is the problem, according to this lesson?","options":[{"text":"The chatbot will refuse to read medical documents.","correct":false,"tempting":"Invents a refusal; the model will read and reword it without comment."},{"text":"The user disclosed someone else's personal data to a third party, for a task that did not need it.","correct":true},{"text":"The chatbot will store the certificate and use it to diagnose the colleague in future answers to other users.","correct":false,"tempting":"Imagines a diagnosis; the harm is the disclosure itself, not a later use of the file."},{"text":"The reworded email will contain invented medical details from the model's training.","correct":false,"tempting":"Reaches for hallucination; rewording supplied text is the reliable task, and the problem is what was supplied."}]},"prev":{"slug":"when-it-starts-to-act","title":"When it starts to act","url":"https://addaly.com/learn/ai-actually-explained/when-it-starts-to-act"},"next":{"slug":"keeping-your-own-judgement","title":"Keeping your own judgement","url":"https://addaly.com/learn/ai-actually-explained/keeping-your-own-judgement"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'What not to hand it', in AI, Actually Explained. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-actually-explained/the-things-to-never-hand-it (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"What not to hand it","courseTitle":"AI, Actually Explained","module":{"index":7,"slug":"putting-it-to-work","title":"Putting it to work without getting burned"},"answer":null,"keyIdea":"A chatbot is not a confidant, a professional or a record-keeper (it has no duty of confidentiality, no accountability and no way to know your jurisdiction) so the things to keep from it are identities, secrets, other people’s data and the final word.","hero":{"kind":"plate","image":"https://addaly.com/art/modules/ai-actually-explained/putting-it-to-work.webp","alt":"A coaching-centre desk with a stack of books, a phone, an open folder of notes, a steel tumbler and a plain wall calendar above.","caption":"Using these tools well is mostly a matter of what you put on the desk beside them and what you decide never to hand over."},"blocks":[{"t":"h2","id":"three-things-a-chatbot-is-not","runs":[{"text":"Three things a chatbot is not"}]},{"t":"p","runs":[{"text":"It is not a "},{"text":"confidant","b":true},{"text":". A doctor, a lawyer and a priest have legal or professional duties about what you tell them. A chatbot has terms of service. In 2025 the chief executive of the largest chatbot company said in an interview that conversations with it carry no legal privilege, and that a court could require them to be produced. People, he said, tell it the most personal things and should know that."}]},{"t":"p","runs":[{"text":"It is not a "},{"text":"professional","b":true},{"text":". Nobody is accountable for its answer. A practitioner who gets it wrong can be struck off, sued or sacked, and that accountability is most of what you are paying for. The model’s answer is a fluent draft with no one’s name on it."}]},{"t":"p","runs":[{"text":"It is not a "},{"text":"record-keeper","b":true},{"text":". What you told it is stored under the previous lessons’ rules, and what it told you is not a record of anything: ask again tomorrow and get a different answer."}]},{"t":"p","runs":[{"text":"From those three follow the things to keep out of the box."}]},{"t":"h2","id":"identities-and-secrets","runs":[{"text":"Identities and secrets"}]},{"t":"p","runs":[{"text":"Your identity documents, and anyone else’s: Aadhaar, passport, PAN, driving licence. Passwords, one-time codes, card numbers, account numbers. These have no business in a system that stores text, may show it to a contractor and may train on it, and they are exactly what a scam will ask you to paste “to verify”. No legitimate task needs a document number to rewrite a paragraph."}]},{"t":"h2","id":"other-people-s-data","runs":[{"text":"Other people’s data"}]},{"t":"p","runs":[{"text":"The moment you paste a colleague’s medical note, a customer list, a student’s essay with their name on it, or a patient’s history, you have disclosed someone else’s personal data to a third party. Under India’s data-protection law of 2023, an organisation that does that is responsible for it, and the same is true under the European rules and most others. Strip the names. If the task needs the names, it is not a chatbot task."}]},{"t":"h2","id":"work-that-is-not-yours-to-share","runs":[{"text":"Work that is not yours to share"}]},{"t":"p","runs":[{"text":"Unreleased code, contracts under negotiation, anything under a non-disclosure agreement, the client’s brief. The electronics company from the earlier lesson banned the tools after its engineers pasted source code. The rule is the same one you would apply to emailing the material to a stranger who promises not to look."}]},{"t":"h2","id":"medical-legal-and-financial-the-shape-of-the-risk","runs":[{"text":"Medical, legal and financial: the shape of the risk"}]},{"t":"p","runs":[{"text":"People use chatbots for these more than for anything else, and the honest advice is not “never”. It is: use it to "},{"text":"understand","i":true},{"text":" and to "},{"text":"prepare","i":true},{"text":", never to "},{"text":"decide","i":true},{"text":", and know the three mechanisms that make the decision unsafe."}]},{"t":"p","runs":[{"text":"It invents specifics.","b":true},{"text":" Dosages, deadlines, section numbers, tax thresholds (the exact things a decision turns on) are the exact things the hallucination module told you it fabricates. In 2023 two New York lawyers filed a brief containing six cases the chatbot had made up, complete with quotations, and were fined by the court. The cases sounded exactly like cases."}]},{"t":"p","runs":[{"text":"It does not know where you are.","b":true},{"text":" Law, tax, drug approvals and medical guidelines differ by country and by state, and the training text is weighted toward the United States. An answer that is correct in Texas can be wrong in Tamil Nadu, delivered with the same confidence."}]},{"t":"p","runs":[{"text":"Its knowledge stops.","b":true},{"text":" Rules change; the cut-off lesson explained that the model’s do not, and a search tool bolted on helps only if it finds the current rule and the model reads it correctly."}]},{"t":"p","runs":[{"text":"So: ask it to explain the terms in your blood-test report so that you can ask your doctor better questions. Ask it what questions a tenant should ask a lawyer. Ask it what the categories on a tax form mean. Then take the questions to the person whose name goes on the answer. That is not a failure of the tool. It is what the tool is for."}]},{"t":"h2","id":"the-final-word","runs":[{"text":"The final word"}]},{"t":"p","runs":[{"text":"The last thing not to hand it is the decision itself. A model can lay out options, draft the letter, summarise the arguments and argue the other side. It cannot carry the consequence, and a decision made by someone who cannot carry the consequence is not a decision; it is a guess with good grammar. The next lesson is about how to keep that line when the guesses are this good."}]}],"check":{"question":[{"text":"A user pastes a colleague’s medical certificate into a chatbot to reword the covering email. What is the problem, according to this lesson?"}],"options":[{"text":[{"text":"The chatbot will refuse to read medical documents."}],"correct":false,"tempting":[{"text":"Invents a refusal; the model will read and reword it without comment."}]},{"text":[{"text":"The user disclosed someone else’s personal data to a third party, for a task that did not need it."}],"correct":true,"tempting":null},{"text":[{"text":"The chatbot will store the certificate and use it to diagnose the colleague in future answers to other users."}],"correct":false,"tempting":[{"text":"Imagines a diagnosis; the harm is the disclosure itself, not a later use of the file."}]},{"text":[{"text":"The reworded email will contain invented medical details from the model’s training."}],"correct":false,"tempting":[{"text":"Reaches for hallucination; rewording supplied text is the reliable task, and the problem is what was supplied."}]}],"order":[3,2,1,0],"why":null},"prev":{"slug":"when-it-starts-to-act","title":"When it starts to act","minutes":10},"next":{"slug":"keeping-your-own-judgement","title":"Keeping your own judgement","minutes":9}}}