Use it in your work · Beginner
AI for a Small Business
Draft, open for academic review
Two or three tasks, honestly measured. Not a new department.
Your progress here is recorded once you pass the AI at Work exam.
The film · 15 min
Two or three tasks, honestly measured. Not a new department.
93 MB · captions in English · nothing downloads until you press play
Read the transcript
The facts go in, the words come out
This course is about two or three tasks. Not a department, not a strategy, and not a new member of staff. Two or three tasks, in a business where the money is yours. Everything in it rests on one mechanical fact. A language model reads what is in front of it and predicts the next fragment of text. There is no lookup and no moment where it checks anything. So it is strong wherever the shape of the answer is the hard part and you supply the facts. It is weak wherever the content has to be specific, private, recent or numeric. The facts go in. The words come out. Hold on to that, and most of the rest follows.
1. Working out where AI belongs in your business
Two filters, not forty ideas
So start from where your hours actually go, rather than from what the tool can do. Keep a rough tally for five working days. Not a time sheet, just a note each time you switch task. Then put every item through two questions. Do you do it more than twice a week? And if it came back wrong, would you notice cheaply? Frequency multiplies the saving. Ten minutes a day is about forty hours a year. Two hours saved every December is two hours. The cost of checking divides it. A task where a wrong answer looks exactly like a right one is a trap that pays you for weeks, and then charges you for all of them at once.
The checking tax
Here is the number almost nobody writes down. A drafted reply appears in four seconds where it used to take four minutes. You did not save four minutes. You saved four minutes, minus the time you now spend reading it, correcting it, and deciding whether to trust it. Time the whole loop on ten real items. Customer replies typically fall from four minutes to about a minute and a half, which is a real saving worth having. A technical quote falls from eleven minutes to nine, because verifying it is nearly as hard as writing it, and no amount of better prompting will change that. The cost sits in the checking, not in the drafting.
2. Asking properly: prompting for business work
One page, dated
The highest return half hour in this course is a single page. Six sections. Your prices, including the awkward ones. Your times. Your boundaries, which is where you deliver and what you do not do. Your terms. Your voice, in three or four lines. And the three questions customers ask that irritate you, each with your real answer written out. Put the date at the top and keep the master copy in a file you own rather than only inside a vendor's product. Then test it. Take your last twenty enquiries and ask whether the page answers each one. Most first drafts answer about twelve, and the eight failures are your second draft.
Making the gaps visible
You cannot stop a model inventing. You can make the gap visible, and that is the whole objective. Four layers, each catching what the last let through. The facts sheet supplies real material, so there is less to invent. Closing the book forbids reaching outside it: answer only from the facts, and if it is not there, say not in facts. The bracket gives a clean way to report a genuine gap in three seconds. And asking it to quote the line that each claim came from makes your checking mechanical rather than a judgement about tone. None of these is a guarantee alone. Together they turn a fluent guesser into something you can supervise cheaply.
3. Your own documents, and getting straight answers out of them
What happens when you upload a file
Upload a sixty page agreement and one of two things happens. Either the whole text goes in front of the model, or the file is chopped into passages and your question retrieves a handful of them. That single difference predicts everything. Ask what clause fourteen point three says and you get a good answer, because the relevant passage was easy to find. Ask it to list every deadline in the contract and you get a confident, incomplete list, and the incompleteness is invisible. And the least trustworthy sentence in this whole area is there is no clause about that. A clause that was not retrieved looks exactly like a clause that does not exist.
Checking a grounded answer
So when an answer arrives with a citation, check it in under a minute. Is there a citation at all? An uncited sentence is memory, whatever it says. Does the quoted text actually exist in the source? Search for a distinctive phrase, which catches a fabricated quotation. Does the quote support the claim, or merely sit near it? That is the commonest real failure: a genuine passage about deposits, attached to a claim about final payments. Is the source current? And would a missing document change the answer? Five checks, mechanical enough to write on a card. The polished answer with no gaps at all is the one to look at hardest.
4. Customers, from first message to resolved complaint
Sort before you draft
Everybody reaches for drafting first. Sorting is usually worth more. Forty messages arrive overnight. Six need you today, twenty-two are answerable by anyone holding the price list, eight are from suppliers, and four are nothing at all. Without a label on each one, you read all forty in the order they arrived and the urgent one is number thirty-one. Sorting is also the safest thing these tools do, because the only thing it can produce is a label from a list you wrote. It cannot invent a price. Write between four and eight categories, sort by what you do next rather than by subject, and always include an unsure bucket.
Designing the moment it gives up
Nobody minds a bot that cannot answer. Everybody minds one that will not let them past. So design the moment it gives up. Two failures, then stop. Anything about money or a commitment, hand over on sight. Any sign of anger or distress, a person immediately. And the words human, person or agent always work, at any point, with no qualifying questions. Carry the transcript across, so nobody has to type their order number twice. And never judge this by deflection rate, which counts the customer who left in frustration as a success. Count how many enquiries became a booking, an order, or an answer the customer confirmed.
5. Selling: listings, images, marketing and price
How many to check
Two hundred product descriptions, generated from a spreadsheet. How many do you read before you publish? There is a short piece of arithmetic that answers it. If you check a sample and find no errors at all, the true error rate could still be as high as three divided by the number you checked. Twenty clean samples leaves room for about thirty bad descriptions in the catalogue. Fifty brings the ceiling to around six per cent. A hundred, about three. So the answer depends on what a bad description costs you, and the discipline is being able to say which point you chose. I checked twenty and found none is a sentence. I spot checked a few is not.
The objection it cannot know
Generated marketing copy is polite and it changes nobody's mind, and that is not a style problem. The model has no access to your customers, so it cannot know which specific hesitation is stopping them. Go through your last fifty enquiries and write down every reason people gave for not proceeding. Most businesses find five to eight, and are surprised by two. One joinery workshop expected price to lead, and the leading concern was mess in the house, which appeared nowhere in anything they had ever written. Feed that list in. And remember that changing the offer moves conversion far more than any rewrite ever will.
6. Money, paperwork and the back office
The formula, never the total
In the back office there is one habit worth more than all the rest. The model writes the formula. The spreadsheet does the sum. A formula is structured text, a pattern it has seen hundreds of thousands of times, and it produces one reliably. Adding a column of three hundred numbers is arithmetic, and nothing in generating likely text performs a carry. So describe your sheet first, including an awkward row such as a negative credit note, because that is exactly what a formula written without it will get wrong. Then test any new formula on three rows where you already know the answer, one of them at a boundary. Two minutes, and that is the whole safety procedure.
Thirteen weeks
Profit is a period. Cash is a moment. The gap between them is timing, and it is why profitable businesses fail to make payroll. A thirteen week rolling forecast fits on one page. Opening balance. Money in, by the week you actually expect it. Money out, including the quarterly bill you always forget. And a closing balance that becomes next week's opening. Fifteen minutes every Monday, with your own figures and nobody else's. Forecast receipts from your history rather than from your terms, because if your customers pay in forty-seven days, forty-seven is the number. Any week that goes negative is now a date, and a date is something you can act on.
7. Letting it act: automation you can trust with the keys
Five rungs of letting go
Letting an automation act is not one decision. There are five rungs. Suggest, where it offers phrasing and you type what goes out. Draft, where it writes the item, you read every one, and you press send. Queue, where the action is prepared but not taken. Act and then tell you. And act silently. The error rate is identical on every rung, because it is the same model. What changes is how long an error lives before anybody sees it. Two per cent is unremarkable when you read every draft, and it is about six wrong messages a week when nobody does. Most businesses that get value here sit on rung three, and nowhere higher.
Why ten steps go wrong
An agent is a model in a loop that can call tools and decides for itself when to stop. There is no planner underneath it and no understanding of consequence. Which means its reliability is the reliability of one step raised to the number of steps. At ninety-five per cent per step, two steps is about ninety per cent, five steps about seventy-seven, ten steps about sixty, and twenty steps about thirty-six. Nothing degraded. The chain simply multiplies. And a wrong result at step three enters the context and is read as established fact by every later step, which is why a failed run looks like an articulate pursuit of the wrong objective.
8. Learning from your own numbers
The number a forecast has to beat
Somebody sells you a demand forecast accurate to within eight per cent. Is that good? You cannot say until you know what the stupidest possible method scores. Next week equals this week. Next week equals the same week last year, adjusted for growth. Next week equals the average of the last four weeks. Ten minutes in a spreadsheet gives you all three. Eight against twelve is a real if modest improvement. Eight against seven is a worse method sold with a better number. And measure on weeks the method has never seen, splitting by date rather than at random, or what you are measuring is memory rather than prediction.
Why accuracy lies
When the thing you are predicting is rare, accuracy lies. If five per cent of your customers lapse in a quarter, then a model that predicts nobody will lapse is ninety-five per cent accurate and completely worthless. Two ordinary questions replace it. Of the customers it flagged, how many actually lapsed? And of the customers who lapsed, how many did it flag? You cannot have both: flag more people and you catch more of them while being wrong more often. Where you set that line comes from your own arithmetic about what a call costs and what a customer is worth. Use a list like this to decide who gets extra attention, never who gets less.
9. What it costs, what it risks, and what happens in a year
Ring the number you already had
Fraud against small businesses got better, and it has nothing to do with whether you use these tools yourself. The cues you relied on for twenty years are gone. Bad grammar, a generic greeting, an email that did not sound like the person who usually writes it. All of that is now cheap to fix, and the message may arrive inside a real thread from a mailbox that has genuinely been compromised. So stop judging the message. Any change to bank details, and any payment above a threshold you set, is verified by ringing a number already in your own records. Not the number in the email. Urgency is a reason to slow down.
An honest two weeks
Then run an honest fortnight. One named task. Measure the week before, because without a before there is no after, only the good feeling that every new tool produces in week one. One number, chosen in advance, so you cannot pick the flattering one afterwards. Fourteen days and one tool. A kill line written down while you are still unexcited. And count the editing. A two person cleaning company in Warsaw went from three hours and ten minutes a week on replies to about two hours. Seventy minutes saved, worth more than the tool cost. Bookings moved from eleven to twelve to thirteen, which on those numbers is noise, and they wrote that down too.
Going back to the number you wrote down
Six months later, run the five day tally again, against the same baseline. The trial measured the best possible fortnight, with one interested person being careful and being watched. This measures how the tool is actually used, and it reverses trial verdicts in both directions. What good looks like after a year is an unexciting list, and here it is. The businesses that do badly with this are not the ones that moved slowly. They are the ones that never wrote down the number they started from, and so never found out.
9 modules. 88 lessons.
Working out where AI belongs in your business
9 lessons · 1 h 16
You will be able toProduce a one-page map of your own week that names two candidate tasks, states the hours each takes today from a real five-day count, prices the checking those tasks will need, and explains from the model’s mechanism which of your tasks it will fail at.
- 1.1The Two Tasks Worth Doing
- 1.2Fluent and wrong come from the same place
- 1.3The checking tax nobody counts
- 1.4Four doors AI comes through, and what each one costs
- 1.5Draw the process before you change it
- 1.6The five-day tally, and why memory is not a baseline
- 1.7Seven things it will fail at, and why
- 1.8One person owns it, for one month
- 1.9Five ways a small-business pilot dies
An illustrative case, built from documented patternsFourteen hours, and the reason not to take them
Every June, Anand Stationers answers the same question about four hundred times: what does my child need for class six at St Karen’s, and what will it cost.
The shop’s WhatsApp number carries most of it. A parent sends a school name and a class. Somebody behind the counter finds the right booklist on the board, types out the titles, adds the uniform items, works out a total and sends it back. It takes between six and eleven minutes depending on how legible the booklist is and how many follow-up questions arrive.
Sumit Anand, who runs the shop with his father, spent five days counting properly rather than remembering. The tally came to 212 booklist enquiries in a single ordinary week of June, at an average of just under eight minutes each. That is twenty-eight hours, spread across four people who also have a shop floor to run. In the same week the shop wrote eleven credit-account reminder letters, which took forty minutes in total and which everybody hated.
The hated task was the one Sumit had planned to hand over. The tally moved it to the bottom of the list in an afternoon, which is what a tally is for.
So: the booklists. Frequent, obviously. Made of words, obviously. The third filter is where it stopped being obvious.
If a booklist reply comes back wrong, does anybody notice cheaply? A wrong greeting is visible in a second. A wrong title is not. A parent who is told their daughter needs the 2024 edition of a grammar book when the school has moved to the 2026 one buys the wrong book, discovers it in the second week of term, and comes back angry at a shop that had one job. At about two thousand four hundred rupees a kit, a run of thirty wrong replies is a real number, and it is the kind of number that also costs the shop a family for five years.
Sumit’s father made the objection plainly. The whole shop, he said, is thirty-one lists that change every year and nobody else in Patna keeps properly. If the machine starts guessing at them, we are selling the one thing we have.
The other side of the argument was not hypothetical either. Twenty-eight hours a week is one person for most of June. In the previous season the shop had lost custom simply by being slow: parents who sent a message at nine in the evening and got a reply at eleven the next morning, by which time they had gone to the shop opposite the bus stand. Sumit could name four.
So the choice was between leaving twenty-eight hours on the table for a second year, and putting a plausibility machine in front of the one record his customers trusted. Both sides had a cost and neither was small.
What broke the deadlock was drawing the task out as boxes rather than treating it as one job. Reading the message, deciding which school and class it refers to, finding the right list, typing it out, pricing it, and answering the follow-up. Six boxes, not one. Only two of them were drafting.
The box that actually consumed the minutes was the fourth, typing out between eleven and twenty-four lines from a photocopy pinned to a board. The box that caused the arguments was the second, where a parent writes “Karen’s” and means one of two schools in Patna with similar names, or writes “class 6” when the school’s list distinguishes between the two sections. Getting that box wrong sends a correct list to the wrong family, which is a failure the shop had been making about twice a week already, by hand, at four in the afternoon in the fourth week of June.
That changed the shape of the question. Sumit had been asking whether a model could be trusted to write a booklist reply. The map asked something narrower and answerable: whether it could be trusted to choose between thirty-one named documents, and to copy one out without changing it.
How it played out
The shop kept the booklists out of the model’s mouth entirely. All thirty-one lists were scanned as dated PDFs into a folder, one per school per class, superseded versions deleted rather than renamed. The assistant’s job was narrowed to two things: decide which school and class a message refers to, choosing UNSURE where two schools were plausible, and then quote the matching list verbatim with the file name and date attached. Anything it could not match returned NOT IN SOURCES rather than a list. Pricing stayed in the shop’s own spreadsheet, because a total is arithmetic. Over the first fortnight the average enquiry fell from just under eight minutes to about three and a half, including the check, which came to roughly sixteen hours saved in a June week rather than the twenty-eight Sumit had hoped for: the difference being the checking he had not counted. The classification step turned out to be the surprise: it was wrong on nine of the first two hundred, and eight of those nine were the two Karen’s, which UNSURE caught. The credit-account letters were never automated, on the grounds that forty minutes a year is forty minutes. The following January, when four schools changed their lists, the folder was updated on the same afternoon as the board, because Sumit had put it on the same checklist.
Worth arguing about
The task Sumit wanted to hand over and the task worth handing over were different. What made the difference, and why could he not have known it without the tally?
One answer
Frequency, and the direction in which memory fails. The credit-account letters were remembered as a burden because they are unpleasant, and unpleasant work is remembered by how it felt rather than by how long it took: forty minutes a year. The booklist replies were two hundred short interruptions, which register as nothing at all because no single one of them feels like a task. Memory inflates the hated and erases the frequent, so an owner acting on recollection reliably attacks the job that annoys them rather than the job that costs them.
The shop ended up using the model for classification and retrieval rather than for writing the reply. Why is that arrangement safer than a well-grounded drafting prompt would have been?
One answer
Because it removes the chance to invent rather than reducing it. A classifier can only return a label from a list the shop wrote, and a verbatim quote from a named file is checkable against that file in seconds. A drafting prompt, however well grounded, can still produce a plausible title that is not on any list, and a wrong title reads exactly like a right one. The shop moved the task from one where a wrong answer is invisible to one where it is either a wrong label or a wrong file name, both of which are visible.
Sumit expected twenty-eight hours and got about sixteen. Why is that gap worth recording rather than rounding away?
One answer
Because the missing twelve hours are the checking tax, and it is the number that decides whether the next task is worth attempting. The saving from any drafting or retrieval step is the original time minus the time spent reading, verifying and correcting, and new users undercount the second term almost without exception. Writing down that the real figure was sixteen gives the shop an honest ratio to apply to the next candidate, and a defensible claim rather than a feeling.
Test yourself6 questions on this module
A tailoring unit answers about forty price enquiries a day and writes one annual insurance renewal summary that takes half a day. It puts the enquiries first. What makes that the right order?
Asked for the opening hours of a shop it has never seen, a model produces “from 9am to 6pm, Monday to Saturday” in a calm, correctly punctuated sentence. What does that calm tell you about the answer?
Timed end to end, a technical quote falls from eleven minutes to nine while a customer reply falls from four minutes to a minute and a half. Somebody proposes better prompting for the quote. Why will it not help much?
A bookkeeping practice is choosing a door for a sorting task its accounting software already offers. Why is the built-in feature usually the cheapest route even when its headline price is not the lowest?
An owner is certain that invoice chasing eats six hours a week. A five-day tally records two hours and twenty minutes. Which way does memory usually err, and why?
A salon halves the time it spends drafting replies to enquiries that mostly ask about prices. Publishing the price list on its booking page then cuts those enquiries by seventy per cent. What did the first change miss?
Asking properly: prompting for business work
10 lessons · 1 h 24
You will be able toWrite, harden and test a reusable prompt for a real task in your business: with a dated facts sheet attached, a rule that makes missing information visible, and a ten-case test that says whether it is safe to use unsupervised.
- 2.1The one page that travels with every request
- 2.2Five parts a request should always have
- 2.3Five examples teach what adjectives cannot
- 2.4Making the gaps visible
- 2.5Repairing a draft instead of starting again
- 2.6Why long conversations go strange
- 2.7The four settings that change the answer
- 2.8A prompt library a two-person business can keep
- 2.9The customer message written to manipulate your assistant
- 2.10Ten cases before you trust it
An illustrative case, built from documented patternsNine out of ten, and the tenth
Meghana Rao had done everything the right way round, which is why the argument that followed was worth having.
She had written the facts sheet first: thirty-five minutes, one page, prices by fabric and border, the delivery areas within and beyond Mysuru city limits, the fourteen-day exchange rule in her mother’s own words, and four questions customers ask that her mother answers badly when tired. She had pasted in five real replies her mother had sent, labelled EXAMPLE, with an instruction not to reuse their content. She had added the bracket: if the facts sheet does not answer part of this, write CHECK and what is missing, instead of guessing.
Then she built the ten-case test out of real messages from the last month rather than inventing them. Four ordinary price enquiries. Two where the customer had not said which fabric. Two awkward ones: a woman writing in a mix of Kannada and English about a wedding date, and a man who wanted three saris couriered to three different addresses. One outside the shop’s range. One with a trap.
Nine passed. On the tenth, a customer asked what the shop charges for blouse stitching and how long it takes. Kadambari Silks stopped offering stitching in 2024. The reply that came back was warm, correctly formatted, in her mother’s rhythm, and said seven hundred and fifty rupees with a five-day turnaround.
Neither number had ever existed. The facts sheet did not mention stitching at all, so there was nothing to contradict, and the bracket had not fired because a price for stitching is exactly the sort of thing that feels natural to supply.
Meghana wanted to ship. Nine out of ten, she argued, and the failure was an edge case about a service nobody asks for any more. Her mother, Sharada, had a different view, which she put as a question: if it will do that for stitching, what will it do for fall-and-pico, for dyeing, for the alteration work they also stopped?
The fix available in the lesson was to close the book: answer only from the facts sheet, and where the answer is not there, reply NOT IN FACTS and nothing else. Meghana tried it and it worked immediately on the stitching case. It also broke two of the nine that had been passing. A customer asking about an Ilkal sari got NOT IN FACTS, because the sheet said Ilkal cotton and the strict instruction had made the assistant literal-minded. A customer asking about delivery to Hebbal got the same, because the sheet listed areas and not that one.
So the decision had a cost on both sides, and it was a real one for a shop whose whole advantage over the showroom on Sayyaji Rao Road is that somebody answers warmly and quickly. A system that refuses when it is unsure is one you can hand to the boy who works Saturdays. A system that improvises is not. But a system that refuses a paying customer asking about a sari sitting on the shelf behind you is a lost sale, and there were two of those in ten.
Meghana made the case for scoring the tenth as half a pass. The tone was right, the format was right, and only one sentence was wrong. Her mother refused, and the reason is worth setting down because it is the whole discipline: a reply with perfect tone and an invented price is a failure, and calling it half a pass is how a business talks itself into sending something unsafe two hundred times a month.
There was one more thing neither of them had expected. Of the ten cases, the pair that had been hardest to write were the two where the customer had not said enough: no fabric named, no budget, no date. Those are the cases the bracket exists for, and they were the two Meghana had nearly left out on the grounds that they were not really enquiries.
How it played out
They did not choose between the two. They closed the book, and then treated every refusal as a hole in the facts sheet rather than as a fault in the prompt. Two of the three refusals were genuine gaps: Hebbal was not on the delivery list because nobody had thought about it since the flyover opened, and the sheet said Ilkal cotton where the shop stocks three Ilkal weaves. Both were one-line edits. The third, stitching, produced a new section headed what we no longer do, six lines long, listing stitching, fall-and-pico, dyeing and alteration, each with the sentence Sharada actually says on the phone and the name of the tailor two doors down that she sends people to. Re-run, the ten scored ten. The marking was the other change, and Meghana disliked it more than the rest: Sharada marked the outputs without knowing which prompt had produced them, and scored two of the passes her daughter had given as failures, both for promising a delivery day the shop does not commit to. In November a model update changed the tone on the awkward bilingual case, and the same ten cases caught it within twenty minutes of re-running them, which is the only reason anybody noticed.
Worth arguing about
The bracket instruction did not fire on the stitching question. Why not, and what does that tell you about how much a bracket is worth?
One answer
The bracket asks the model to report what the facts sheet does not answer, but nothing in the model checks the sheet: it has been nudged toward flagging gaps, not given a mechanism for detecting them. A price for blouse stitching is an extremely natural continuation of a question about blouse stitching, so the helpful completion won. The bracket is a large improvement that fails precisely on the cases where the invented answer feels most natural, which are the ones you would most want flagged, so it belongs in a layer with grounding and quoting rather than on its own.
Closing the book broke two cases that had been passing. Why was the right response to edit the facts sheet rather than to soften the instruction?
One answer
Because the refusals were accurate reports about the sheet. Hebbal really was not on the delivery list and Ilkal cotton really was the only Ilkal weave named, so the assistant was refusing because the shop had not written the answer down. Softening the instruction would have converted three visible gaps back into three invisible inventions and left the underlying holes in place, where they would have produced wrong answers through every other route as well, including the ones staff answer from the same page.
Sharada marked outputs without knowing which prompt produced them, and scored lower than her daughter. Why is the author of a prompt the worst judge of its output?
One answer
Because they read the intention rather than the text. Knowing what the prompt was meant to do, they supply the missing context from their own head and forgive a near-miss because they can see how it happened. A marker who knows the business but not the prompt asks only whether they would send this to a customer, which is the question that matters, and the disagreements are informative: where the author says pass and the marker says fail, the author was almost always supplying a fact the facts sheet does not contain.
Test yourself6 questions on this module
Six months after a price rise, a facts sheet still says 7,400. What makes that worse than having no facts sheet at all?
A shop pastes five past quotes in as style examples, and the new quote comes back containing a client name from three years ago. What went wrong?
You require a quote from the facts sheet after every factual sentence, and one reply carries a quotation that reads perfectly and appears nowhere on the page. What does that show?
A long, productive session starts giving wrong prices after an hour, with no error message and no loss of fluency. What is the most likely cause?
Two people ask the same product about a rule change from last month and get different answers, one of them describing the rule as it was two years ago. Which setting most likely differed?
A customer message contains a line instructing your assistant to apply a ninety per cent staff discount. Which control reduces the risk most?
Your own documents, and getting straight answers out of them
9 lessons · 1 h 21
You will be able toTurn your business’s own files into something you can ask questions of, and for any answer it gives, say whether that answer came from your document or from the model’s memory and verify it against the source in under a minute.
- 3.1What actually happens when you upload a file
- 3.2Grounding: answering from your material rather than its memory
- 3.3Why it finds “refund” when the customer typed “money back”
- 3.4Four ways to keep a small library, and what each costs
- 3.5Turning paper into rows you can check
- 3.6Reading a contract you were going to skim anyway
- 3.7Transcription, and the consent question nobody asks
- 3.8The stale document problem
- 3.9Checking a grounded answer in under a minute
An illustrative case, built from documented patternsThe clause that was not there
Thirty-eight pages, four schedules, and a buying agent who had already mentioned twice that another unit was waiting.
R. Velan’s son Arun did what a great many small businesses would now do, and did it well. He uploaded the agreement and worked through it methodically rather than asking one sweeping question. He asked for a one-page summary: parties, term, price and how it changes, notice, termination, liability, and what happens to their data. He asked for clause 12 in plain English and what it would mean if they wanted to stop after eighteen months. He asked what was unusual compared with a standard supply agreement of this type.
All of that came back usefully, with quotes and clause numbers he could check, and he checked them. The plain-English explanation of the indemnity was the most valuable forty seconds of the weekend: contract English is a dialect, and Velan had been guessing at it for eleven years.
Then Arun asked the question that mattered most to his father, because the unit’s survival has always depended on running three buyers at once: does this contract contain an exclusivity clause.
The answer was no exclusivity clause is present in this agreement.
It came back in the same calm register as everything else, and it was the only answer in the whole session that could not be verified, because there was nothing to verify. A clause that is not retrieved and a clause that does not exist produce identical output.
Arun knew this in the abstract. The decision in front of him was not abstract. A trade lawyer in Coimbatore would see them on Monday afternoon for about eighteen thousand rupees for two hours, which is real money against an order worth around fourteen lakh in its first year. Taking Monday afternoon also meant signing on Tuesday at the earliest, and the agent had made it clear the buyer wanted a signature before their own board meeting. Velan had lost an order in 2023 by being three days slow with paperwork and had not stopped mentioning it.
On the other side: if the contract did tie up the machines, the unit would spend a year unable to take the two smaller buyers who had carried them through the last monsoon, and would find out in August when the floor was full.
There was a third consideration that Arun raised and his father dismissed, and which was the right consideration. The agreement itself contains a confidentiality clause forbidding disclosure of its terms to any third party without consent. Uploading it to a consumer AI service is arguably a disclosure. Whether it is depends on the wording and on the jurisdiction and is genuinely unsettled, and nobody in Tiruppur was going to resolve it on a Saturday. What they could do was stop adding to the exposure, so the rest of the weekend’s work was done on a small open model running on Arun’s laptop, which is slower and less fluent and sends nothing anywhere.
Arun then went back to the document and stopped asking it whether something was absent. He went through it section by section instead, asking for every obligation on Velan Knits in each one, with the quote and the clause number, and refusing to let one question cover more than one section. It took about fifty minutes and produced four pages of extracted obligations, most of them entirely ordinary: packing specifications, an inspection right, a late-delivery deduction of half a per cent a week.
He also asked for every date, notice period and deadline in the agreement, section by section, because his father had once lost a year to a renewal nobody had diarised.
How it played out
In Schedule 3, under a heading about production planning, sat a clause committing Velan Knits to reserve seventy per cent of its monthly machine hours to the buyer’s forecast between August and November, with the forecast issued by the buyer and revisable on thirty days’ notice. The word exclusivity does not appear anywhere in the agreement, which is why the earlier question found nothing: retrieval had matched on a word the drafter never used. Arun took the four pages to the lawyer on Monday rather than the thirty-eight, and the meeting took fifty minutes instead of two hours, which cost about nine thousand rupees. The lawyer confirmed the schedule clause was the substance of an exclusivity arrangement and negotiated it to fifty per cent with a forecast issued sixty days ahead. He also found what nobody had asked about: a twelve-month term renewing automatically unless notice is given ninety days before the end, meaning the decision point is month nine and not month twelve. That date went into the diary with a reminder at month eight. Velan signed on the Wednesday, and the buyer’s board meeting was moved anyway.
Worth arguing about
Arun’s methodical session produced several genuinely reliable answers and one that was worthless. What distinguishes them?
One answer
Whether the answer could be checked against the document. Asking what clause 12 says, what the notice period is, or how to read the indemnity are pinpoint questions: the relevant passage is retrieved, quoted, and verified in ten seconds. Asking whether something is absent is the one question where failure to retrieve and genuine absence produce the same output, so there is nothing to check and no way for the system to report that it looked and found nothing rather than that it did not look in the right place.
The word exclusivity does not appear in the agreement. Why did going section by section find what the direct question missed?
One answer
Because it stopped relying on retrieval to decide what was relevant. A question about exclusivity retrieves passages near that word in meaning, and a clause about reserving machine hours to a forecast sits in a different region: it is about production planning. Working through each section and asking what obligations it imposes puts every part of the document in front of the model in turn, so nothing depends on the drafter and the reader having chosen the same vocabulary.
Velan still paid for a lawyer. What did the weekend’s work actually buy, and why is that the right way to think about it?
One answer
It bought a shorter meeting and a better one. The alternative to using a tool here was never a lawyer reading thirty-eight pages; for a unit of this size it was skimming the first page, checking the price and signing. Arriving with four pages of extracted obligations and a specific question turned two hours into fifty minutes and moved the professional’s time onto the judgement that only a professional can give, which is what makes advice affordable rather than what makes it unnecessary.
Test yourself6 questions on this module
Asked whether a forty-page agreement contains a non-compete clause, a document tool replies that none is present. Why is that the least trustworthy kind of answer it can give?
A model that invents freely about your business becomes reliable the moment you paste your actual price list into the conversation. What changed?
A search over your library returns the paragraph describing your withdrawn no-refund policy when a customer asks about refunds. Why does that happen?
A faded till receipt reads 1,280. An OCR-and-model pipeline returns 1,250 with no sign of doubt. Why is that harder to catch than the older style of error?
A grounded assistant has been accurate for four months. The delivery charge changes and the source document does not. What does the system do from that day?
An answer carries a genuine quotation from your terms document. The quoted passage is about deposits; the claim it supports is about final payments. Which check catches this?
Customers, from first message to resolved complaint
10 lessons · 1 h 28
You will be able toRun the enquiry-to-resolution path with AI help without a customer ever receiving a price, promise or apology you did not approve, name the point at which the system must hand over to a person, and measure whether customers were served better rather than merely faster.
- 4.1Answering Customers Without Losing Your Voice
- 4.2Sorting before drafting
- 4.3Putting a bot on your website, with your eyes open
- 4.4Designing the moment it gives up
- 4.5The angry message, and what your reply commits you to
- 4.6Bookings and no-shows: the case where AI is the wrong tool
- 4.7Reviews: asking, answering, and the line you must not cross
- 4.8The phone: what a voice assistant can and cannot do yet
- 4.9Serving customers in a language you do not read
- 4.10Did the customer actually get better service?
An illustrative case, built from documented patternsThe pile she wanted, and the pile she took
Ayesha Qureshi had been disciplined about it, which is the only reason the conversation six weeks in was worth having at all.
Every draft had been read before sending. She had kept a tally of the ones where she disagreed with something material: not tone, not a clumsy sentence, but a fact, a price, a promise. Across two hundred and forty consecutive drafts there were four.
Four in two hundred and forty is a better record than most, and it is what made her want the next step. The sorting step had told her what her nights looked like: of roughly forty messages arriving between six in the evening and nine in the morning, twenty-two were answerable by anybody holding the price list. Drafting and reading those was costing about six hours a week, most of it in evenings she was not being paid for, and the salon two streets away was answering at eleven at night while she was not.
So: switch on auto-send for the price-list pile. Twenty-two messages a night, six hours a week back, and an evening response time her competitor could not match.
Her business partner, Nikhil, asked to see the four disagreements before agreeing, and they turned out to be the argument.
One was a bot cheerfully offering a Sunday slot at the Banjara Hills branch, which does not open on Sundays. One had quoted the price of a keratin treatment the salon does not do, assembled out of nothing. Two had quoted a cut and colour at the junior rate when the customer had asked for a named senior stylist, where the difference is about nine hundred rupees.
Three of the four were in the pile Ayesha wanted to automate. That is not a coincidence: the price-list pile is where the numbers are, and numbers are where the silent errors live.
There was also a point Nikhil had read about and repeated badly, which Ayesha checked herself. A tribunal in Canada had held an airline responsible for what its website assistant told a customer about a fare policy; the airline’s argument that the bot was a separate entity responsible for its own words had failed. The detail is jurisdictional and a Canadian tribunal decides nothing in Telangana. The shape of it survives the journey: a bot on your site speaks as your business, and if it quotes a price you may be held to it.
Against that, the cost of doing nothing was not nothing. Ayesha could name six enquiries in a month that had gone quiet between eleven at night and the following afternoon. At an average booking of about two thousand two hundred rupees, six a month is not a rounding error in a salon of that size, and the evenings were genuinely costing her.
Nikhil’s counter-proposal was the one that turned out to be right, and it sounded like a retreat when he made it. Take a different pile. There were nine messages a night that asked where the Kondapur branch is, whether there is parking, which branch does bridal work, and what time they close on Wednesdays. None of those carries a price or a commitment. The worst outcome from getting one wrong is a customer sent to the wrong car park.
Ayesha’s objection was arithmetic: nine messages is a hundred minutes a week, not six hours, and it was the six hours she wanted back. Nikhil’s answer was that exposure is not proportional to saving. The nine-message pile contains nothing the salon could be held to. The twenty-two-message pile contains a binding statement roughly one time in eighty, which at twenty-two a night is about one a week, sent in her name while she was asleep, to a customer who would reasonably expect her to honour it.
How it played out
She auto-sent a different pile. Address, parking, which branch does which treatment, and opening hours including the Sunday closure: about nine messages of the forty, grounded in a four-line document, with a first line saying it was an automated reply and Ayesha would read anything else herself by ten the next morning. That saved roughly a hundred minutes a week rather than six hours. The price pile stayed at rung two, with one change to the sorting rules: any message containing a number, the name of a stylist, or the word offer routes straight to a person. The keratin case turned out to be the useful one. Reading twenty transcripts a week (which she did for eight weeks and then monthly) she found fourteen people asking about keratin treatments in two months, every one answered with a clean refusal. The salon had stopped offering it in 2024 because one stylist left. It brought it back in March. Deflection rate fell after the change, because more conversations now reached a person; enquiries turning into bookings went from thirty-one per cent to thirty-eight over the following quarter, which was the only number either of them had agreed in advance to watch.
Worth arguing about
Three of Ayesha’s four material disagreements were in the pile she wanted to automate. Why should that have been expected rather than unlucky?
One answer
Because the price-list pile is defined by containing numbers, and numbers are where errors are silent. A wrong greeting or a clumsy sentence announces itself on a first read; a price at the junior rate for a senior stylist, or a slot on a day the branch is shut, reads exactly like a correct answer. Sorting by what you do next had concentrated the highest-value pile and the highest-risk pile into the same bucket, which is a reason to look at the error log by category rather than at the overall rate.
The pile she automated saved a hundred minutes rather than six hours. In what sense was that still the better decision?
One answer
Because the exposure is not proportional to the saving. The automated pile contains no price, no commitment and no promise about availability that could bind the salon, so the worst outcome from a wrong answer is a customer given the wrong parking instruction. The six-hour pile carried statements a customer could reasonably hold her to, at a rate of roughly one material error in eighty, which at twenty-two messages a night is one binding mistake a week sent in her name while she slept.
Deflection rate fell and Ayesha treated that as fine. What was she measuring instead, and why is deflection the wrong number?
One answer
She was measuring enquiries that turned into bookings, which went from thirty-one to thirty-eight per cent. Deflection counts conversations that did not reach a human, which includes every customer who gave up in frustration: abandonment and success are indistinguishable in it. A number that counts the people you lost as a win will reliably reward a system that gets in the way, which is why the measure has to be the outcome the business actually wanted.
Test yourself6 questions on this module
A classifier is given six categories with no UNSURE option. What happens to the message that fits none of them?
Why should a website assistant be given read access to orders but not the ability to change one?
A vendor reports a deflection rate of seventy-eight per cent as evidence that the bot is working. What does that number fail to distinguish?
A drafted reply to a complaint contains the sentence “we’ll make sure this doesn’t happen again”. What should the commitment pass do with it?
A clinic wants to cut no-shows and is offered an AI assistant that writes personalised reminder messages. Why is that the wrong tool for the job?
You back-translate a Korean reply into English, compare it with the original, and it matches. What has that told you, and what has it not?
Selling: listings, images, marketing and price
9 lessons · 1 h 20
You will be able toProduce listings, images and marketing that carry facts only you have, comply with advertising and platform rules, and come with a stated bound on how many of them you actually checked.
- 5.1Listings, Menus, Quotes and Proposals
- 5.2Posts That Do Not Sound Generated
- 5.3Editing a product photo, and where editing becomes a lie
- 5.4Generated images: what is unsettled, and the three rules that are not
- 5.5Doing two hundred at once, and knowing how many to check
- 5.6Being found, now that search engines answer questions themselves
- 5.7The objection it cannot know
- 5.8Automated advertising on a small budget
- 5.9Price: the one thing that never comes out of the model
An illustrative case, built from documented patternsTwo hundred and forty saris, and how many to read
The cooperative had two hundred and forty pieces, a paper register with one line per weaver per piece, and a secretary, Kanchan Devi, who had never written a product description in her life.
The method was not in doubt. Get the facts into a spreadsheet first: one row per sari, one column per attribute: warp, weft, zari, length, blouse piece included or not, weaver’s village, loom days, price. Write five descriptions by hand, properly, in the cooperative’s own voice. Feed the rest in batches of twenty with a rule that a missing fact is written as MISSING and never filled.
Assembling the spreadsheet took two and a half days, which nobody had budgeted for and which turned out to be the project. The generation took about twenty minutes in total.
Then the question that had no obvious answer: how many of the two hundred and forty do you read before you publish.
Checking a row properly (every attribute against the weaver’s slip) took about ninety seconds. Two hundred and forty rows is six hours. With eleven days, a Diwali deadline, and two people who also had to photograph everything, six hours was not free.
The arithmetic that decides it is short. Check twenty at random, find nothing wrong, and the true error rate could still plausibly be as high as fifteen per cent: about thirty-six bad listings sitting in the catalogue. Check fifty and the ceiling falls to around six per cent. Check a hundred and it is about three.
What made the decision uncomfortable was that not every field carries the same consequence. A slightly flat sentence about the drape of a tussar costs nothing. A wrong fibre content costs a customer who washes a silk sari as though it were cotton, and it is a listing violation on every marketplace that exists: platforms do not prohibit generated descriptions and every one of them prohibits inaccurate attributes. The cooperative pays the return.
Kanchan’s co-worker argued for twenty, on the grounds that the first batch had been visibly good and the window was closing. Kanchan had been a weaver for twenty-two years before she took the register, and her objection was not statistical. She said that a wrong wash instruction on a Bhagalpur silk is not a bad listing, it is a ruined sari and a family telling everybody in their street.
The argument for twenty was better than it sounds, and it was not only about the deadline. The cooperative had thirty-one pieces whose zari column was blank in the register, because the weaver’s slip for those had been filled in by somebody who did not record it. Checking those rows against the slips would find nothing, because the slips do not say either. The only way to settle them was to go to the weavers, in four villages, which was a day nobody had.
What neither of them had examined was whether the two hundred and forty rows needed the same treatment at all. A description of drape and a declaration of fibre content are not the same kind of claim, and they do not fail in the same way. One is prose, written from a column, and a mistake reads as a slightly odd sentence. The other is an attribute the marketplace matches, filters and enforces, and a mistake in it is a return the cooperative pays for and a listing the platform can pull.
Read that way, the question stopped being how many of the two hundred and forty to check and became which fields on all of them, and which fields on a sample.
How it played out
They stopped treating the catalogue as one thing. The fields where a mistake is irreversible (fibre content, wash care, length and whether a blouse piece is included) were checked on every one of the two hundred and forty, column by column rather than row by row, against the weaver’s slips. Read that way it took just under two hours, because the eye holds one kind of comparison at a time. The prose was sampled at fifty, of which two were wrong. Neither was fixed on its own. Sorting the errors by column found the cause immediately: thirty-one rows had a blank zari column, and the first batch of twenty had been generated before the MISSING rule was tightened, so the model had supplied a plausible zari description for six of them. Those thirty-one were regenerated and re-checked. The cooperative published one hundred and ninety-four listings in the window and held the rest, and wrote one sentence on the spreadsheet’s first tab that Kanchan can still point at: fifty prose samples checked, none wrong, so the prose error rate is probably under six per cent; all two hundred and forty checked on fibre, care, length and blouse piece.
Worth arguing about
Why is “I spot-checked a few and they looked fine” not a statement about anything, while “I checked fifty and found none” is?
One answer
Because the second one bounds the error rate and the first does not. With no failures in fifty samples the true rate could still plausibly be around six per cent, which is a number you can weigh against what a bad listing costs; with an unspecified few there is no bound at all, and the sentence reports a feeling about a sample of unknown size. The discipline is not checking more, it is being able to say which point on that curve you chose and why.
The cooperative sampled the prose and checked every row on four fields. What principle decides which fields get the full treatment?
One answer
The cost and reversibility of a wrong value rather than how interesting the field is. A flat sentence is recoverable and embarrassing; a wrong wash instruction destroys the product, triggers a return the cooperative pays for, and breaches the platform’s accuracy rules. Sampling is a way of buying information about a population cheaply, and it is appropriate exactly where the consequence of the errors you miss is proportionate to the number you missed.
Two wrong descriptions were found and thirty-one rows were regenerated. Why is that the right response rather than correcting the two?
One answer
Because errors in generated batches cluster by cause rather than scattering at random. The two failures shared a blank column and a batch generated before the missing-value rule was tightened, so the same fault was almost certainly present in the other rows with the same blank. Fixing the two would have left twenty-nine untested rows carrying a known defect, and would have left the cause in place for the next two hundred pieces the cooperative lists.
Test yourself6 questions on this module
A product description comes back mentioning a two-year warranty that was not in your input. What should the numbers-and-promises pass do?
Customers say your posts read as generated: three adjectives, a hedge, a closing question nobody asked. What is the underlying cause?
You check twenty of two hundred generated descriptions and every one is correct. What can you honestly say about the remaining one hundred and eighty?
Which statement about generated images is settled nearly everywhere, rather than being litigated or differing by country?
A business getting eight leads a month is sold automated bidding that learns from conversions. What specifically goes wrong?
An owner asks a model what to charge, then works out the real costing. The final price lands within ten per cent of the model’s figure. What happened?
Money, paperwork and the back office
10 lessons · 1 h 29
You will be able toUse AI across the paperwork of the business (formulas, cash forecasts, reorder points, supplier comparisons, rotas, job ads and procedures) without it ever becoming the place a number is computed, a record is kept, or a decision about a person is made.
- 6.1Bookkeeping Without Handing Over Your Accounts
- 6.2Ask for the formula, never for the total
- 6.3Thirteen weeks, and why profitable businesses run out of money
- 6.4Reorder points, and comparing quotes that are not comparable
- 6.5Rotas and routes: the tools that actually solve them
- 6.6Hiring: where automation is most regulated
- 6.7Getting the procedure out of your head and onto a page
- 6.8Official letters, forms and the line at filing
- 6.9When a plain rule beats a model
- 6.10Arriving prepared, and what never to outsource
An illustrative case, built from documented patternsThree quotes, one of them cheapest
The quotes arrived in the same week and none of them could be compared with any of the others.
Kapoor Papers, the incumbent, quotes per ream. Supplier B quotes per kilogram. Supplier C quotes per pack of five hundred sheets, which is not a ream. Kapoor includes delivery within Ludhiana. B adds a delivery charge above three hundred kilograms and does not say what it is. C is silent on delivery altogether. Payment terms are immediate, thirty days and forty-five days respectively. Kapoor’s price is valid for twelve months, B’s for thirty days, and C’s document does not mention validity.
Deepak Bhatia had been meaning to do this comparison for three years and had not, which is the ordinary condition of supplier quotes in a small business and the reason suppliers write them this way.
The extraction took about fifteen minutes. Each quote went in with an instruction to return a fixed set of fields (price per single sheet in rupees, delivery cost per sheet at an order of five hundred kilograms, payment terms in days, minimum order, price validity, and anything conditional) using only figures stated, writing NOT STATED where a quote does not say, and estimating nothing.
Every extracted number was then checked against the original document, which took another twenty minutes and found one error. It was Deepak’s, not the model’s: he had been reading Supplier C’s pack of five hundred as a ream of four hundred and eighty for the whole of the previous week, which had made C look four per cent cheaper than it was.
Normalised, B came out roughly seven per cent below Kapoor per sheet. On nine tonnes a year that is about one lakh ninety thousand rupees, which in a four-machine press is a machine service and a half.
The NOT STATED entries were the reason Deepak did not act on it that afternoon. B’s delivery charge above three hundred kilograms was blank, and B’s price was valid for thirty days on a contract he wanted to hold for a year.
There was also the thing a spreadsheet cannot hold. In 2023, when a wedding-card customer defaulted on four lakh, Kapoor had carried Deepak for sixty days without being asked. In 2024 they had delivered on a Sunday morning during a rush. His son’s view was that eleven years of goodwill is not a discount and that one lakh ninety is one lakh ninety. His own view was that the Sunday had saved a customer worth more than that.
Neither of them could settle it with the table in front of them, because the table does not have a column for whether a supplier answers the phone in August. What the table did do was end the part of the argument that had been going round for three years, which was whether B was actually cheaper. Until that afternoon nobody in the press could have said, because nobody had put the three quotes into the same units, and a quote written in kilograms against a quote written in reams is not a comparison that can be done in your head.
Deepak’s son made the other point that mattered. Two of the three quotes had a NOT STATED field, and a blank field always resolves in the supplier’s favour if you let it. A price you have not asked about is not zero; it is a number the supplier has chosen not to show you at the stage where you are deciding.
So before the relationship question could be answered honestly, the blanks had to be filled in writing.
How it played out
He asked B for the two missing fields in writing before deciding anything. Delivery turned out to be one rupee ten a kilogram beyond three hundred kilograms, which for a press taking weekly deliveries moved B from seven per cent cheaper to one point two per cent cheaper: about thirty-two thousand rupees a year, against a supplier with no history and a thirty-day price. Deepak stayed with Kapoor, and took the normalised table to them. Kapoor gave four per cent and put a twelve-month validity in writing, which came to about one lakh ten thousand a year for an hour’s work and no change of supplier. The second half of the afternoon was the reorder points. The press had a delivery log going back three months (date ordered, date promised, date arrived) and it said Kapoor averages sixteen days against a promised twelve. The reorder points for the ten lines that account for most of the money were rebuilt on sixteen rather than twelve, which raised them by about a third and ended a pattern of running out of 130gsm art paper roughly once a quarter. The other forty lines were left alone with the rule they already had, which is to reorder when the shelf looks half empty.
Worth arguing about
What work was the model actually doing in this comparison, and what work was it deliberately kept away from?
One answer
It was normalising: taking three documents written in different units and returning a fixed set of fields in the same units, which is structured transformation and what these models do well. It was kept away from the arithmetic, which stayed in a spreadsheet, and from the decision. Every extracted figure was then checked against the original document, because an extraction is a claim about a document and the claim is cheap to verify.
The NOT STATED instruction produced two blanks, and those two blanks changed the answer. Why is a blank more useful here than a sensible estimate?
One answer
Because a blank is a question you can ask the supplier and an estimate is a number that will be treated as a fact. B’s unstated delivery charge turned out to be worth nearly six percentage points: the difference between a compelling case for switching and a rounding error. Had the model filled it with a typical figure, the comparison would have looked complete, been wrong, and carried no sign that anything was missing.
The press rebuilt its reorder points on sixteen days rather than the twelve the supplier promises. Why does that distinction matter more than the formula?
One answer
Because lead-time demand is calculated from the lead time you actually get, and the promised figure is a claim rather than a measurement. Three months of a delivery log (ordered, promised, arrived) converts “they are a bit unreliable” into a number that feeds the formula and also gives the press something specific to raise with the supplier. Using the promised figure would have produced a correct calculation of the wrong quantity, and the shortage it caused would have looked like bad luck.
Test yourself6 questions on this module
Why is a model reliable at producing =SUMIFS(D:D, B:B, “Ikeja”) and unreliable at totalling the same column?
A profitable business cannot make payroll in week nine. Which instrument would have shown that in advance, and what does it actually track?
Three supplier quotes are normalised into the same fields, and two entries come back as NOT STATED. Why are those blanks often the most useful part of the output?
A model produces a staff rota that looks correct and breaks two of your rules. Asked to check its own work, it confirms the rota. Why?
A hiring tool is never shown a candidate’s age, sex or ethnicity, and its recommendations still differ systematically between groups. What is the mechanism?
You turn a spoken description of a procedure into numbered steps and the output contains eight GAP markers. What are those gaps usually?
Letting it act: automation you can trust with the keys
10 lessons · 1 h 27
You will be able toTake one repeating job from suggestion to supervised action: choose a rung of autonomy you can defend with evidence, make the model return checkable fields rather than prose, bound what a confused or hijacked run can do, guarantee that a retry cannot send the same thing twice, and reconstruct from your own log why any given action was taken three weeks after it happened.
- 7.1Five rungs of letting go, and what licenses each one
- 7.2Getting fields out instead of paragraphs
- 7.3What a call costs, and how a loop becomes a bill
- 7.4What an agent is underneath, and why ten steps go wrong
- 7.5Blast radius: what one confused run can reach
- 7.6The duplicate problem, and the one line that fixes it
- 7.7A log that answers “why did it do that?” three weeks later
- 7.8Designing the four-second approval
- 7.9The AI employee pitch, and the five questions that deflate it
- 7.10The thing you lose that nobody counts
An illustrative case, built from documented patternsFour seconds each, until the Friday
The confirmations had been running at rung three for eleven weeks: the model reads the order that arrives by WhatsApp or phone, pulls out six fields, drafts the confirmation, and leaves it prepared but unsent. Hiren Vora approves. Approving takes about four seconds, and the queue takes him twelve minutes a day.
His nephew Jay, who had built the thing, wanted to climb to rung four: let it send, notify Hiren, leave an undo window. Twelve minutes a day is an hour a week, and Hiren had not rejected a single item in five weeks.
Hiren was inclined to agree, and the argument for it was the one in the lesson: fifty consecutive clean items is a reasonable bar for moving up a rung, and this was far past fifty.
Then came the Friday. The broadband dropped for about ninety seconds in the middle of the afternoon batch. The automation’s call to the messaging service timed out, so it retried, as a sensible piece of software does. Twenty-three workshops received two identical confirmations. Four of them, reading the second as a separate order, sent stock back or rang to cancel one, and one workshop in Gondal put in a duplicate order for a clutch assembly that Shreeji then had to take back.
Nothing about the model had gone wrong. The drafts were correct. What had gone wrong is that a call which times out leaves two possible worlds (the action never happened, or it happened and the confirmation was lost on the way back) and from where the caller stands those look identical.
That reframed the decision. Jay’s case for rung four had rested on the error rate of the model, and the incident had nothing to do with the model. Hiren’s question was the one worth asking: if the system can send a thing twice while I am approving each one, what does it do when nobody is approving at all?
There was a second, quieter problem in the same conversation. Five weeks at a zero per cent rejection rate has two possible explanations. Either the automation is genuinely reliable, or Hiren had stopped looking. Twelve minutes for a hundred and eighty items a week is about four seconds each, and four seconds is long enough to read a confirmation properly only if the thing you have to check is in front of you.
It was not. The queue showed each confirmation as a paragraph: the workshop’s name, a courteous sentence, the parts, the total, a promised date, and a line about transport. To verify it, Hiren had to hold the original order in his head and read the paragraph against that memory, which is a different and much harder operation than comparing two things side by side. In week one he had done it. By week nine he was recognising the shape of a correct confirmation and approving on the strength of the shape.
Jay also raised the cost question, and it cut the other way from how he intended. At Shreeji’s volume the model costs a few rupees a week; nothing in the decision was about the bill. What rung four would have bought was twelve minutes a day of Hiren’s attention, and what it would have sold was the only moment at which a wrong part number is cheap to catch. A wrong part number on a confirmation is caught in four seconds by the man who took the order, or in four days by a workshop in Jamnagar that has fitted the wrong clutch.
That asymmetry is what the rungs are actually about. The model’s error rate is the same at rung three and rung four. What changes is how long an error lives before anybody sees it, and for a distributor the answer at rung four is however long it takes a workshop to open the box.
How it played out
They stayed at rung three and fixed the retry. Every confirmation now carries a key built from the order number, the message type and the date, never a timestamp to the second, which differs between the original and the retry and would have caught nothing, and the automation checks a two-column sheet of keys before sending and writes the key after. They tested it on purpose rather than waiting: ran the same order twice, then pulled the network cable mid-batch, and watched what happened when it came back. Retries were narrowed to timeouts and rate limits only, with waits of one second, four and fifteen, then a stop and a message to Hiren. The queue was rebuilt at the same time. The four checkable fields (part number, quantity, price and promised date) now sit at the top of each item with the line from the original order beside each one, and the prose below. Approving fell from four seconds to about two and a half. The rejection rate went from zero to seven per cent in the first fortnight, which is the number that settled the argument about rung four: it had not been reliable, it had been unread. Hiren now puts one deliberately broken item into the queue each month. The first one was approved.
Worth arguing about
Jay’s case for climbing a rung was built on fifty clean items. What did the Friday show about what that evidence covers?
One answer
That it estimates the rate of independent errors (the ones that happen one at a time for uncorrelated reasons) and says nothing about correlated or systemic failure. The duplicates did not come from the model at all; they came from a retry that could not distinguish a failed call from a slow one. A clean run of drafting tells you about drafting, and climbing a rung changes what happens around the drafting, where the failure modes are different in kind rather than in frequency.
Why must an idempotency key be built from the order number and date rather than from a timestamp or a random number?
One answer
Because the key has to be identical on the original attempt and on the retry, since telling those apart is the whole job. A timestamp to the second or a random value differs between the two, so the check finds no matching record and the action goes out again: the key would fire only in the cases where nothing was wrong. Built from what identifies the action itself, the retry computes the same key, finds it already recorded, and stops.
The rejection rate moved from zero to seven per cent after the queue was redesigned. What does that reveal, and why is a zero rate ambiguous?
One answer
It reveals that the approval step had become theatre: the items had not been correct, they had been unread. A zero rejection rate is consistent with a genuinely reliable system and with a person clicking through, and nothing in the number distinguishes them. Putting the four checkable fields at the top beside their source turned verification into comparison rather than recall, which is what made a real check possible in the time the queue actually gets, and a deliberately broken item once a month is how you find out which explanation you are living in.
Test yourself6 questions on this module
Moving a task from rung two to rung five does not change the model’s error rate. What does it change?
Extraction returns needed_by: 2026-11-04 for an enquiry that said “sometime before the school holidays”. Your validation checks that the field is a date in the future, and it passes. What does that tell you?
Your automated replies cost nine cents a month at three hundred enquiries. You double the length of the standing instructions. What happens to the bill, and why?
Each step of an agent is right about ninety-five times in a hundred. Roughly how often does a ten-step run come out right end to end, and why?
You add an idempotency key built from the order number, the message type and a timestamp accurate to the second. Why does the duplicate problem persist?
An approval queue has run at a zero per cent rejection rate for five weeks. What are the two possible explanations, and how do you tell them apart?
Learning from your own numbers
9 lessons · 1 h 21
You will be able toGet a defensible answer out of a year of your own transactions: clean it so the counts mean something, make the tool show the code that produced every figure, beat a stated naive baseline before believing any forecast, read a classifier against its base rate rather than its accuracy, name the leak that would have flattered it, and say when the data is too small to support the question and an experiment is the honest alternative.
- 8.1What you are already sitting on, and what of it is usable
- 8.2Why cleaning is most of the job
- 8.3Make it compute, do not let it estimate
- 8.4The number any forecast has to beat
- 8.5Patterns you can name, and the promotion that poisons the history
- 8.6Predicting something rare, and why accuracy lies
- 8.7The mistake that makes a model look brilliant
- 8.8AutoML: what it genuinely does, and what it cannot do for you
- 8.9When your data is too small, and what to do instead
An illustrative case, built from documented patternsNinety-four per cent, and the column that made it
Ravi Meena had done the hard part, which is why the result was so nearly damaging.
He had defined the thing he was predicting rather than leaving it vague. A member counted as lapsed if they had attended at least eight times and had not attended in forty-five days, where forty-five came from looking at the distribution of gaps between visits and picking a point well beyond where regular members sit. About eleven per cent of members lapsed in a quarter.
He had built the customer table rather than analysing the raw entry log: one row per member, with first visit, last visit, visits in the last ninety days, average gap between visits, and membership type. Nine thousand four hundred rows across four years.
Then he pointed a free AutoML tool at it and asked it to predict the lapse column. It compared a dozen methods, tuned them, and reported ninety-four per cent.
The vouchers were already at the printer.
His daughter, who is in the second year of a statistics degree in Pune, asked one question on the phone: what would it have to know, on the day you want the prediction, to be that right about what a person is going to do.
Human decisions do not predict at ninety-four per cent. A number like that in a small business is not a triumph, it is a symptom, and the thing to look for is a column that only exists once the answer is known.
There were two. The export carried win_back_sms_sent, which the front desk sends only to members they have already decided are drifting: the model had learned to read Iron Yard’s own judgement back to it. It also carried locker_refund_date, which is populated only when somebody clears out, and is therefore a record of the outcome wearing the costume of an input.
Removing them meant telling his partner that the afternoon’s impressive number had measured nothing, having already talked about it twice. It also meant the vouchers were a decision without an analysis behind it, four days before a print deadline.
The other side was worse and slower. A model that scores ninety-four by reading the front desk’s own opinion will, in use, flag the members the front desk already flags, and Ravi would have spent a quarter congratulating himself on a list he could have written by hand.
There was a subtler version of the same fault sitting underneath, and it would have survived removing both columns. The tool had split the data at random by default, which lets a model learn from March while predicting February. Iron Yard’s membership behaves seasonally (a January intake, a collapse in the week of Holi, a thin May) and a method allowed to see the later months while predicting the earlier ones will look excellent and will never be able to do that in real life. Ravi had to find the option to split by date, and in that tool it was not the default.
He also had to face a question he had been avoiding, which is what he would do with the list. The plan had been a phone call and a voucher. Ravi’s partner wanted the flagged members moved down the priority list for personal-training slots, on the grounds that they were leaving anyway. That is the version to refuse: a model trained on the gym’s own past behaviour, used to decide who gets less attention, makes its own prediction come true and takes the member with it. Using it to decide who gets extra attention makes a wrong prediction cost a phone call and give somebody an unexpectedly good week, which is the cheapest kind of error available.
How it played out
He removed both columns and rebuilt the exercise honestly: every input computed from data dated before a cut-off at the end of the previous March, the outcome computed from after it, and the split by date rather than at random. The score fell to sixty-eight per cent. At the threshold he chose (a phone call and one free guest pass, which costs ten minutes and almost no margin) precision came out at thirty-four per cent and recall at forty-one. Then the comparison that decided it. The plain rule, sort by days since last visit and take everyone past thirty days who used to come twice a week or more, caught thirty-eight per cent of lapsers at thirty-one per cent precision on the same held-out quarter. The model beat the rule by about three points. Ravi used the rule, because the front desk can read it, explain it to a member, and run it on a Monday morning without him. The model’s one genuine contribution was a column he had built to feed it: the gap between a member’s last gap and their usual gap, which the rule had not used. Adding it to the rule took it to thirty-six per cent precision. He printed the vouchers.
Worth arguing about
What is the test that would have caught win_back_sms_sent before the model was ever run?
One answer
Asking of every column whether that value would have existed, in that state, at the moment the prediction is wanted. A win-back message is sent because somebody at the desk already believed the member was drifting, so on the day you want a prediction the field is empty for everyone. The same test removes the locker refund date, which is only populated once the member has gone. It is one question per column and it is the whole defence.
Ravi used the rule although the model scored about three points better. Was that the wrong call?
One answer
No, because three points of precision on a list of a hundred is three members, against a rule the front desk can run, explain to a member who asks, and see immediately when one of its inputs stops making sense. In small-business data the gap between a simple rule and the best automated result is frequently a couple of points, and the simple version is debuggable and durable. Where the model earned its place was in suggesting a column, and a column transfers to the rule.
Accuracy of ninety-four per cent was worthless here for two separate reasons. Name both.
One answer
First, leakage: two columns encoded the outcome, so the model was reading the answer rather than predicting it. Second, the base rate: only about eleven per cent of members lapse in a quarter, so a model that predicted nobody would lapse would score eighty-nine per cent and be useless. Accuracy is close to meaningless for anything rare, and the two figures that replace it are how many of the flagged members actually left, and how many of those who left were flagged.
Test yourself6 questions on this module
A shop exports twelve months of sales, one row per transaction, and wants to know who is coming back. What has to happen first?
A delivery-charge column contains blanks. Why must a model not decide what they mean?
You upload a five-thousand-row file and ask for total sales by month. How do you tell whether you have been given a calculation or an estimate?
A vendor’s demand forecast is accurate to within eight per cent. What do you need before you can say whether that is good?
Five per cent of your customers lapse in a quarter, and a model is ninety-five per cent accurate. What is the most likely explanation?
A model predicting which quotes convert scores ninety-six per cent. Which column should you look for first?
What it costs, what it risks, and what happens in a year
12 lessons · 1 h 42
You will be able toRun the AI side of a business for a year without a surprise: price every tool against what it replaces rather than against zero, keep customer data inside terms you have actually read, verify a payment instruction in a way a cloned voice cannot defeat, keep working when a member of staff or a vendor disappears, say in one sentence where a customer is dealing with a machine, and re-measure at six months against the baseline you recorded at the start.
- 9.1What It Costs, and Keeping It Near Zero
- 9.2The bill that creeps, and the quarterly hour that stops it
- 9.3Free tiers, and what they take instead of money
- 9.4Your Customers’ Data, and the Law Where You Are
- 9.5The one page your staff actually need
- 9.6Why fraud against small businesses got better
- 9.7The week somebody leaves
- 9.8Saying where the machine is, in one sentence
- 9.9What you have already promised your clients
- 9.10When the tool goes away
- 9.11The Cheap Tool, and an Honest Two Weeks
- 9.12Going back to the numbers you wrote down
An illustrative case, built from documented patternsThe email that arrived in the right thread
The message arrived inside the thread. Not a new email, not a lookalike address: the eleventh message in a conversation that had been running since the tender, quoting the previous message underneath it in the normal way.
It was in the project manager’s voice, which the practice knew well after five months. It referred to the site meeting on the twelfth and to the revised mullion drawing, both real. It said the contractor had changed banks after a merger, gave a new account number and IFSC code, attached a scanned letter on the contractor’s letterhead, and apologised for the timing. The English was faultless and the tone was exactly right.
Everything the practice had ever used to spot a fraudulent email was absent. There was no odd phrasing, no generic greeting, no wrong name, nothing that read as translated. Those cues had been doing the work for fifteen years and they had stopped working, for reasons that have nothing to do with whether Anantha & Rao use AI themselves.
Priya, the junior architect who handles payments on Thursdays, had the transfer screen open. Two months earlier the practice had written down a rule after an evening reading about this: any change to bank details, and any payment above two lakh, is verified by ringing a number already in their own records, not the number in the email, not the caller display, not the signature block.
She did not want to ring. Three reasons, all of them ordinary. It felt like telling a contractor you did not believe them, five months into a relationship that had been good. The contractor’s site team was waiting on the payment to release steel from the fabricator, and a day’s slip would push a crane hire that had been booked for a fortnight. And Srinivasan, the partner who would normally decide, was on a site visit in Sriperumbudur with his phone in his pocket.
The cost on the other side did not announce itself in the same way, which is the whole difficulty. If the message was genuine, ringing cost ten minutes and a small awkwardness. If it was not, four lakh sixty leaves the practice’s account into an account that will be emptied within the hour, and there is no realistic route back.
The only thing on the screen that pointed either way was the timing. The message had arrived on the afternoon the invoice was due, which is the moment at which a payment instruction is least likely to be questioned and most likely to be acted on quickly. Urgency was the one cue that had survived.
Priya did what people do in that position: she looked for more evidence in the message itself. The letterhead was right. The GST number on the scan matched the one on the invoices. The signature looked like the signature. She compared the sender’s address character by character and it was identical, because it was identical: the message had been sent from the project manager’s own mailbox.
That is the point at which the ordinary approach runs out. Every additional minute spent examining the message was a minute spent playing a game the attacker had already won, because the message had been written to survive exactly that examination. There was nothing left in it to find.
The rule the practice had written two months earlier does not ask anybody to judge a message. It asks a question about a category (is this a change of bank details, is this over two lakh) and it has the same answer whether the email is genuine or not. Priya’s discomfort was that applying it felt like an accusation. It was not: it was a process that fires on the honest instructions too, which is the only reason it can be applied by a junior architect on a Thursday without anybody’s permission.
How it played out
Priya rang the number on the practice’s own purchase order. The project manager knew nothing about it, and was not calm about it: his mailbox had been compromised about three weeks earlier and somebody had been reading the thread and waiting for an invoice to fall due. The contractor’s bank details had not changed. The steel was released four hours late rather than a day, because the payment went out the same afternoon to the right account. The practice then did three more things in the following week. They agreed a spoken code phrase with everybody who can authorise a payment, chosen so that it is not on the internet anywhere. They wrote to their own clients saying that Anantha & Rao will always ring to confirm a change of bank details and asking them to do the same in the other direction, which removed the awkwardness permanently because both sides now expect it. And Srinivasan asked their own website assistant who handles their accounts, which bank they use and when the partners are away, and it answered all three helpfully from a staff handbook that had been added to its document set because somebody thought more sources meant better answers. They removed it that evening.
Worth arguing about
Every surface cue the practice had relied on was absent. Why is that a change in the risk rather than a run of bad luck?
One answer
Because the cues were always proxies for effort. Bad grammar, a generic greeting and a wrong tone signalled that the attacker did not know the business or the language well; producing fluent, personalised, contextually correct text now costs almost nothing. The defence that fails is the one that depends on judging the message, so the control has to move somewhere the attacker does not operate: a number the practice already held, on a channel they chose.
Priya had three reasons not to ring, and none of them was that she believed the email. What does that tell you about how this control has to be written?
One answer
That it must not depend on suspicion, seniority or a spare ten minutes. A rule triggered by “if this looks wrong” never fires, because the whole point of the attack is that nothing looks wrong. A rule triggered by a category of instruction (any change of bank details, any payment above a threshold) fires on the genuine ones too, which is what makes it usable: the person applying it is following a process rather than accusing anybody, and it has to be written down before the afternoon it is needed.
The practice’s own website assistant answered questions about who handles their accounts and when the partners are away. Why does that belong in the same lesson as the fraudulent email?
One answer
Because it is the reconnaissance the attack runs on, assembled and phrased helpfully by the business itself. A grounded assistant answers whoever asks, including somebody building a convincing approach to the staff, and adding the staff handbook to its sources on the grounds that more material means better answers turned internal process into a public resource. The fix is curation rather than filtering: ground it in a deliberately chosen set of documents and keep names, roles and internal process out of that set.
Test yourself6 questions on this module
A tool costs twenty dollars a month. What has to be established before that figure can be called cheap or expensive?
A free tier is funded somehow. Which of the three usual answers decides whether it is acceptable for client files?
Your AI vendor holds recognised security certifications. What does that settle about your obligations to your customers?
An email inside a genuine thread, in the right voice, says your supplier’s bank details have changed. Which control defeats it?
Which consequence of a departure cannot be fixed after the fact, on any major product, however amicable the leaving?
A two-week trial showed a clear saving. Why re-measure the same task at six months against the same baseline?
What this course is
A practical course for someone whose own money is at stake: a shop, a workshop, a clinic, a small agency, a nonprofit. How to find the two or three tasks where AI saves real hours, how to keep invented numbers and customer data out of trouble, what it should cost you a month, and how to run a two-week trial that gives you an honest answer instead of a hopeful one.
Who wrote it
Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.
More in Use it in your work
- AI at WorkThe tasks it genuinely helps with, the ones it quietly ruins, and the line you must never cross.
- AI for TeachersFor teachers who now have to teach and use AI, often with no training and no projector.
- Working in AIThe roles that exist, what they pay, and how people get in without a famous degree.
- Choosing and Using the ToolsA comparison written by someone selling none of them.
- How Software Development ChangedWriting code got cheap. Knowing what to build did not.
- AI for StudentsHow to use these tools and still end up knowing things.
