{"course":{"slug":"ai-and-you","title":"AI, Safety and What Goes Wrong","url":"https://addaly.com/learn/ai-and-you","level":"beginner","track":"start"},"lesson":{"slug":"the-liability-question","title":"Who is responsible when it is wrong","url":"https://addaly.com/learn/ai-and-you/the-liability-question","position":8,"of":73,"minutes":4,"answer":"Deploying a system never moves responsibility onto it, so the business still answers.","keyIdea":"Deploying a system never moves responsibility onto it, so the business still answers."},"body":{"format":"markdown","text":"## Ninety days, according to the chatbot\n\nOn 11 November 2022 Jake Moffatt's grandmother died in Ontario. That day he asked the chatbot on Air Canada's website about bereavement fares. It told him that if he had already travelled he could apply for the reduced rate \"within 90 days of the date your ticket was issued\". He booked at full price, flew, and applied. Air Canada refused. Its bereavement page said the policy did not cover requests made after travel.\n\nBefore British Columbia's Civil Resolution Tribunal, Air Canada said it could not be held liable for information given by its agents, including a chatbot. The tribunal said that amounted to treating the chatbot as \"a separate legal entity that is responsible for its own actions\", and called it \"a remarkable submission\". The chatbot is still just part of Air Canada's website, and the airline is responsible for all the information on it, whether it comes from a static page or a chatbot. On 14 February 2024 the tribunal ordered Air Canada to pay C$812.02.\n\n> Figure: What the chatbot said, and what the tribunal decided. Air Canada's chatbot, November 2022: Already travelled? You can still apply; Apply within 90 days of the ticket's issue date; Use the Ticket Refund Application form. The tribunal, 14 February 2024: The policy page said no claims after travel; The chatbot is still just part of the website; Air Canada did not take reasonable care; Pay C$812.02: damages, interest and fees. Air Canada said it was not liable for what its chatbot said. The tribunal treated the chatbot like any other page the airline published.\n\nThe principle is the one most harms in this course turn on: responsibility lands where it would have landed if a member of staff had said the same thing.\n\n## Where the chain holds\n\nAny deployed system sits in a chain: the model provider, the company that built a product on it, the organisation that deployed it, the professional who used the output, and the person affected. Details differ by country. Three patterns hold.\n\n**Professional duties stay with the professional.** A lawyer who files invented cases is sanctioned as a lawyer, as in [Mata v. Avianca](/learn/ai-and-you/what-actually-goes-wrong). A doctor is judged by the medical standard of care.\n\n**What a business tells customers binds the business.** The tribunal applied negligent misrepresentation, the ordinary rule that a business answers for careless statements a customer relies on.\n\n**Providers disclaim.** A model provider's terms usually supply output as is, exclude warranties and cap liability. Some offer business customers indemnities against specific copyright claims, which tells you which risks they have priced.\n\n## The law that is moving\n\nThe European Union's revised Product Liability Directive, adopted in 2024, brings software, including AI systems, within product liability. It also eases the burden of proof where a claimant cannot be expected to explain a complex system. Elsewhere most claims still run through negligence, contract and consumer law.\n\nOne gap is open. When a general-purpose model produces a harmful output in a use nobody foresaw, through no obvious fault of the deployer, most countries do not yet say cleanly who pays. That does not mean responsibility floats free. Almost every harm so far has landed on someone with a duty they already had.\n\n## Three habits if your work touches others\n\n**Your name makes it yours.** That is how the cases have gone.\n\n**Read the contract before the accuracy report.** What is warranted, what is the cap, who indemnifies whom, and what happens when the underlying model changes?\n\n**Keep the record.** Input, output, model version and date. A year later, a missing record does not protect you. It means the dispute is settled without your evidence."},"check":{"question":"A clinic's booking assistant tells a patient a treatment is covered by their insurer. It is not, and the patient faces a large bill. On the decided cases, where does responsibility most likely sit?","options":[{"text":"With the model provider, since the false statement came from its model","correct":false,"tempting":"Follows the harm to its technical source. Provider terms disclaim output, and causation against a general model is hard."},{"text":"With the clinic, because the assistant is part of the clinic's service","correct":true},{"text":"Nowhere yet, because no human spoke and the law has not caught up","correct":false,"tempting":"Assumes novelty defeats liability. The tribunal in Moffatt rejected exactly that argument."},{"text":"With the patient, who should have checked with the insurer directly","correct":false,"tempting":"Carelessness can reduce a claim. It does not free a business from what it presented as its own."}],"why":"As in Moffatt, a business answers for what its own interface tells its customers."},"prev":{"slug":"automation-bias","title":"Why people believe the machine","url":"https://addaly.com/learn/ai-and-you/automation-bias"},"next":{"slug":"risk-by-consequence","title":"Triage: sorting risk by what it costs","url":"https://addaly.com/learn/ai-and-you/risk-by-consequence"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Source and assessment review continues. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Who is responsible when it is wrong', in AI, Safety and What Goes Wrong. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-and-you/the-liability-question (Accessed: 21 November 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Who is responsible when it is wrong","courseTitle":"AI, Safety and What Goes Wrong","module":{"index":1,"slug":"how-things-fail","title":"How these systems fail"},"answer":null,"keyIdea":"Deploying a system never moves responsibility onto it, so the business still answers.","hero":{"kind":"figure","figure":{"t":"figure","label":"Figure","figure":{"caption":"Air Canada said it was not liable for what its chatbot said. The tribunal treated the chatbot like any other page the airline published.","left":{"title":"Air Canada’s chatbot, November 2022","items":["Already travelled? You can still apply","Apply within 90 days of the ticket’s issue date","Use the Ticket Refund Application form"]},"right":{"title":"The tribunal, 14 February 2024","items":["The policy page said no claims after travel","The chatbot is still just part of the website","Air Canada did not take reasonable care","Pay C$812.02: damages, interest and fees"]},"title":"What the chatbot said, and what the tribunal decided","type":"compare"},"alt":"Figure: What the chatbot said, and what the tribunal decided. Air Canada’s chatbot, November 2022: Already travelled? You can still apply; Apply within 90 days of the ticket’s issue date; Use the Ticket Refund Application form. The tribunal, 14 February 2024: The policy page said no claims after travel; The chatbot is still just part of the website; Air Canada did not take reasonable care; Pay C$812.02: damages, interest and fees. Air Canada said it was not liable for what its chatbot said. The tribunal treated the chatbot like any other page the airline published."}},"blocks":[{"t":"h2","id":"ninety-days-according-to-the-chatbot","runs":[{"text":"Ninety days, according to the chatbot"}]},{"t":"p","runs":[{"text":"On 11 November 2022 Jake Moffatt’s grandmother died in Ontario. That day he asked the chatbot on Air Canada’s website about bereavement fares. It told him that if he had already travelled he could apply for the reduced rate “within 90 days of the date your ticket was issued”. He booked at full price, flew, and applied. Air Canada refused. Its bereavement page said the policy did not cover requests made after travel."}]},{"t":"quick","prompt":"What did Air Canada argue before the tribunal?","options":["The chatbot was right","The customer misread it","It was not liable for its chatbot"],"answer":2,"reveal":"That it could not be held liable for what its chatbot said. The tribunal called that a remarkable submission, and rejected it."},{"t":"p","runs":[{"text":"Before British Columbia’s Civil Resolution Tribunal, Air Canada said it could not be held liable for information given by its agents, including a chatbot. The tribunal said that amounted to treating the chatbot as “a separate legal entity that is responsible for its own actions”, and called it “a remarkable submission”. The chatbot is still just part of Air Canada’s website, and the airline is responsible for all the information on it, whether it comes from a static page or a chatbot. On 14 February 2024 the tribunal ordered Air Canada to pay C$812.02."}]},{"t":"p","runs":[{"text":"The principle is the one most harms in this course turn on: responsibility lands where it would have landed if a member of staff had said the same thing."}]},{"t":"h2","id":"where-the-chain-holds","runs":[{"text":"Where the chain holds"}]},{"t":"p","runs":[{"text":"Any deployed system sits in a chain: the model provider, the company that built a product on it, the organisation that deployed it, the professional who used the output, and the person affected. Details differ by country. Three patterns hold."}]},{"t":"p","runs":[{"text":"Professional duties stay with the professional.","b":true},{"text":" A lawyer who files invented cases is sanctioned as a lawyer, as in "},{"text":"Mata v. Avianca","href":"https://addaly.com/learn/ai-and-you/what-actually-goes-wrong"},{"text":". A doctor is judged by the medical standard of care."}]},{"t":"p","runs":[{"text":"What a business tells customers binds the business.","b":true},{"text":" The tribunal applied negligent misrepresentation, the ordinary rule that a business answers for careless statements a customer relies on."}]},{"t":"p","runs":[{"text":"Providers disclaim.","b":true},{"text":" A model provider’s terms usually supply output as is, exclude warranties and cap liability. Some offer business customers indemnities against specific copyright claims, which tells you which risks they have priced."}]},{"t":"h2","id":"the-law-that-is-moving","runs":[{"text":"The law that is moving"}]},{"t":"p","runs":[{"text":"The European Union’s revised Product Liability Directive, adopted in 2024, brings software, including AI systems, within product liability. It also eases the burden of proof where a claimant cannot be expected to explain a complex system. Elsewhere most claims still run through negligence, contract and consumer law."}]},{"t":"p","runs":[{"text":"One gap is open. When a general-purpose model produces a harmful output in a use nobody foresaw, through no obvious fault of the deployer, most countries do not yet say cleanly who pays. That does not mean responsibility floats free. Almost every harm so far has landed on someone with a duty they already had."}]},{"t":"h2","id":"three-habits-if-your-work-touches-others","runs":[{"text":"Three habits if your work touches others"}]},{"t":"p","runs":[{"text":"Your name makes it yours.","b":true},{"text":" That is how the cases have gone."}]},{"t":"p","runs":[{"text":"Read the contract before the accuracy report.","b":true},{"text":" What is warranted, what is the cap, who indemnifies whom, and what happens when the underlying model changes?"}]},{"t":"p","runs":[{"text":"Keep the record.","b":true},{"text":" Input, output, model version and date. A year later, a missing record does not protect you. It means the dispute is settled without your evidence."}]}],"check":{"question":[{"text":"A clinic’s booking assistant tells a patient a treatment is covered by their insurer. It is not, and the patient faces a large bill. On the decided cases, where does responsibility most likely sit?"}],"options":[{"text":[{"text":"With the model provider, since the false statement came from its model"}],"correct":false,"tempting":[{"text":"Follows the harm to its technical source. Provider terms disclaim output, and causation against a general model is hard."}]},{"text":[{"text":"With the clinic, because the assistant is part of the clinic’s service"}],"correct":true,"tempting":null},{"text":[{"text":"Nowhere yet, because no human spoke and the law has not caught up"}],"correct":false,"tempting":[{"text":"Assumes novelty defeats liability. The tribunal in Moffatt rejected exactly that argument."}]},{"text":[{"text":"With the patient, who should have checked with the insurer directly"}],"correct":false,"tempting":[{"text":"Carelessness can reduce a claim. It does not free a business from what it presented as its own."}]}],"order":[3,0,2,1],"why":[{"text":"As in Moffatt, a business answers for what its own interface tells its customers."}]},"prev":{"slug":"automation-bias","title":"Why people believe the machine","minutes":4},"next":{"slug":"risk-by-consequence","title":"Triage: sorting risk by what it costs","minutes":4}}}