{"course":{"slug":"agents-and-automation","title":"Agents and Automation","url":"https://addaly.com/learn/agents-and-automation","level":"intermediate","track":"build"},"lesson":{"slug":"the-maintenance-bill","title":"What it costs to keep it alive","url":"https://addaly.com/learn/agents-and-automation/the-maintenance-bill","position":63,"of":72,"minutes":8,"answer":"Automation is a subscription paid in attention: review volume, error rate, spend and readership quarterly, and delete what nobody reads.","keyIdea":"Automation is a subscription paid in attention: review volume, error rate, spend and readership quarterly, and delete what nobody reads."},"body":{"format":"markdown","text":"## The part nobody budgets for\n\nBuilding an automation is a project. Owning one is a subscription, and the currency is attention.\n\nHere is what changes underneath a working system, none of which is your fault:\n\n- **An upstream API changes.** A field is renamed, a limit is tightened, an endpoint is deprecated. Expect this a few times a year per integration.\n- **A model is retired.** Providers publish deprecation dates; the failure mode is that nobody reads the email. Pin your model version, and put the retirement date in a calendar when you pin it.\n- **Prices change**, and the economics you calculated in module one no longer hold.\n- **A business rule changed and nobody told the automation.** This is the most common and the least visible, because nothing errors. The system keeps applying last year's discount policy with perfect reliability.\n- **The person who understood it left.**\n\n## The quarterly review, twenty minutes\n\nOnce a quarter, for every automation, answer six questions from data you already log:\n\n1. Is it still running?\n2. What is the volume, and is it changing?\n3. What is the error rate, and the validator rejection rate?\n4. What did it cost last quarter?\n5. Who owns it now, and are they still here?\n6. **Does anyone read the output?**\n\nTwenty minutes with a spreadsheet. The first four come from the run log you built in module one. The fifth is a name. The sixth kills more automations than the other five together, and you should ask it first.\n\n## Deleting one is a good outcome\n\nSomewhere in your organisation is a beautifully engineered weekly report with an open rate of zero. It costs money every week, it breaks twice a year, and somebody spends a day fixing it each time because it is \"in production\".\n\nCheck the open rate before you optimise the pipeline. Turning something off is a legitimate, unglamorous, high-return engineering result, and the way to make it easy is to leave it off for a month and see who asks. Frequently nobody does.\n\n## Handing it over\n\nA new owner needs four things:\n\n- **the runbook**, including the failure history\n- **the golden set**, so they can change something and know if they broke it\n- **access to the traces**, so they can see what happened rather than guess\n- **one real run, walked through together**, from trigger to output\n\nThat last one is not optional and takes an hour. If you cannot hand an automation over in about two hours, it is too clever for its job, and the excess cleverness is a liability with a person's name on it.\n\n## The honest closing position\n\nThe automations that survive years are small, boring, observable, owned by a named person, and reviewed on a schedule. They have one model call where a model is needed, deterministic code everywhere else, a validator, an alert that fires when nothing happens, and a runbook with real failures in it.\n\nAlmost none of that is specific to AI, which is exactly the point. The model was never the hard part. Keeping a system honest, in contact with a world that keeps changing, is the hard part, and it always was."},"check":{"question":"During a quarterly review, a weekly report automation shows: running fine, zero errors, costs about $40 a month, owner left in June, and the email open rate is 4%. What is the best action?","options":[{"text":"Assign a new owner and keep it running, since it is stable and cheap.","correct":false,"tempting":"Optimises for the four healthy metrics and ignores the one that says the output is not being used."},{"text":"Reduce cost by switching to a cheaper model, then reassign ownership.","correct":false,"tempting":"Makes an unread report cheaper to produce, which improves the wrong number."},{"text":"Turn it off for a month and see who asks; a 4% open rate means the output has almost no readers, and no owner means nobody to fix it when it breaks.","correct":true},{"text":"Improve the report's formatting to raise the open rate before deciding.","correct":false,"tempting":"Invests more effort in a product nobody asked for, on the assumption that presentation rather than demand is the problem."}]},"prev":{"slug":"alerts-and-the-runbook","title":"The 3am version","url":"https://addaly.com/learn/agents-and-automation/alerts-and-the-runbook"},"next":{"slug":"build-one-real-thing","title":"Build the boring version first","url":"https://addaly.com/learn/agents-and-automation/build-one-real-thing"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'What it costs to keep it alive', in Agents and Automation. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/agents-and-automation/the-maintenance-bill (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"What it costs to keep it alive","courseTitle":"Agents and Automation","module":{"index":7,"slug":"shipping-and-operating","title":"Shipping it, and keeping it alive"},"answer":null,"keyIdea":"Automation is a subscription paid in attention: review volume, error rate, spend and readership quarterly, and delete what nobody reads.","hero":{"kind":"plate","image":null,"alt":null,"caption":null},"blocks":[{"t":"h2","id":"the-part-nobody-budgets-for","runs":[{"text":"The part nobody budgets for"}]},{"t":"p","runs":[{"text":"Building an automation is a project. Owning one is a subscription, and the currency is attention."}]},{"t":"p","runs":[{"text":"Here is what changes underneath a working system, none of which is your fault:"}]},{"t":"ul","items":[[{"text":"An upstream API changes.","b":true},{"text":" A field is renamed, a limit is tightened, an endpoint is deprecated. Expect this a few times a year per integration."}],[{"text":"A model is retired.","b":true},{"text":" Providers publish deprecation dates; the failure mode is that nobody reads the email. Pin your model version, and put the retirement date in a calendar when you pin it."}],[{"text":"Prices change","b":true},{"text":", and the economics you calculated in module one no longer hold."}],[{"text":"A business rule changed and nobody told the automation.","b":true},{"text":" This is the most common and the least visible, because nothing errors. The system keeps applying last year’s discount policy with perfect reliability."}],[{"text":"The person who understood it left.","b":true}]]},{"t":"h2","id":"the-quarterly-review-twenty-minutes","runs":[{"text":"The quarterly review, twenty minutes"}]},{"t":"p","runs":[{"text":"Once a quarter, for every automation, answer six questions from data you already log:"}]},{"t":"ol","start":1,"items":[[{"text":"Is it still running?"}],[{"text":"What is the volume, and is it changing?"}],[{"text":"What is the error rate, and the validator rejection rate?"}],[{"text":"What did it cost last quarter?"}],[{"text":"Who owns it now, and are they still here?"}],[{"text":"Does anyone read the output?","b":true}]]},{"t":"p","runs":[{"text":"Twenty minutes with a spreadsheet. The first four come from the run log you built in module one. The fifth is a name. The sixth kills more automations than the other five together, and you should ask it first."}]},{"t":"h2","id":"deleting-one-is-a-good-outcome","runs":[{"text":"Deleting one is a good outcome"}]},{"t":"p","runs":[{"text":"Somewhere in your organisation is a beautifully engineered weekly report with an open rate of zero. It costs money every week, it breaks twice a year, and somebody spends a day fixing it each time because it is “in production”."}]},{"t":"p","runs":[{"text":"Check the open rate before you optimise the pipeline. Turning something off is a legitimate, unglamorous, high-return engineering result, and the way to make it easy is to leave it off for a month and see who asks. Frequently nobody does."}]},{"t":"h2","id":"handing-it-over","runs":[{"text":"Handing it over"}]},{"t":"p","runs":[{"text":"A new owner needs four things:"}]},{"t":"ul","items":[[{"text":"the runbook","b":true},{"text":", including the failure history"}],[{"text":"the golden set","b":true},{"text":", so they can change something and know if they broke it"}],[{"text":"access to the traces","b":true},{"text":", so they can see what happened rather than guess"}],[{"text":"one real run, walked through together","b":true},{"text":", from trigger to output"}]]},{"t":"p","runs":[{"text":"That last one is not optional and takes an hour. If you cannot hand an automation over in about two hours, it is too clever for its job, and the excess cleverness is a liability with a person’s name on it."}]},{"t":"h2","id":"the-honest-closing-position","runs":[{"text":"The honest closing position"}]},{"t":"p","runs":[{"text":"The automations that survive years are small, boring, observable, owned by a named person, and reviewed on a schedule. They have one model call where a model is needed, deterministic code everywhere else, a validator, an alert that fires when nothing happens, and a runbook with real failures in it."}]},{"t":"p","runs":[{"text":"Almost none of that is specific to AI, which is exactly the point. The model was never the hard part. Keeping a system honest, in contact with a world that keeps changing, is the hard part, and it always was."}]}],"check":{"question":[{"text":"During a quarterly review, a weekly report automation shows: running fine, zero errors, costs about $40 a month, owner left in June, and the email open rate is 4%. What is the best action?"}],"options":[{"text":[{"text":"Assign a new owner and keep it running, since it is stable and cheap."}],"correct":false,"tempting":[{"text":"Optimises for the four healthy metrics and ignores the one that says the output is not being used."}]},{"text":[{"text":"Reduce cost by switching to a cheaper model, then reassign ownership."}],"correct":false,"tempting":[{"text":"Makes an unread report cheaper to produce, which improves the wrong number."}]},{"text":[{"text":"Turn it off for a month and see who asks; a 4% open rate means the output has almost no readers, and no owner means nobody to fix it when it breaks."}],"correct":true,"tempting":null},{"text":[{"text":"Improve the report’s formatting to raise the open rate before deciding."}],"correct":false,"tempting":[{"text":"Invests more effort in a product nobody asked for, on the assumption that presentation rather than demand is the problem."}]}],"order":[1,3,2,0],"why":null},"prev":{"slug":"alerts-and-the-runbook","title":"The 3am version","minutes":8},"next":{"slug":"build-one-real-thing","title":"Build the boring version first","minutes":9}}}