{"course":{"slug":"ai-for-small-business","title":"AI for a Small Business","url":"https://addaly.com/learn/ai-for-small-business","level":"beginner","track":"work"},"lesson":{"slug":"measuring-service-not-speed","title":"Did the customer actually get better service?","url":"https://addaly.com/learn/ai-for-small-business/measuring-service-not-speed","position":38,"of":88,"minutes":8,"answer":"Speed improves immediately and means little on its own, so measure first-contact resolution, repeat contact within 48 hours, enquiry-to-outcome and complaints about the service itself.","keyIdea":"Speed improves immediately and means little on its own, so measure first-contact resolution, repeat contact within 48 hours, enquiry-to-outcome and complaints about the service itself, and never report hours saved without the outcome rate beside it."},"body":{"format":"markdown","text":"## The metric that flatters everybody\n\nResponse time is easy to measure, improves immediately, and is the first number every vendor reports. It is also nearly useless on its own, because a fast wrong answer is worse than a slow right one.\n\nIf you measure only speed, you will optimise for speed, and the system will get faster at producing replies that generate a second message from the same customer asking what you meant.\n\n## Four numbers that mean something\n\n**Resolution on first contact.** Of the enquiries that arrived this week, what proportion were finished in one exchange? This is the honest measure of whether an answer answered. It is harder to count than response time and it is the one worth counting.\n\n**Repeat contact within 48 hours.** The same customer coming back about the same thing. This rises when replies get faster and worse, and it is the clearest early warning that something has degraded. Watch it in the fortnight after any change.\n\n**Enquiry to outcome.** Of the people who asked, how many booked, ordered or got what they came for? This is the number that connects the front desk to the business, and it is the one that tells you whether a change was worth making at all.\n\n**Complaints about the service itself.** Not about the product: about being made to talk to a machine, or not being able to reach anybody. A small number, and each one is worth reading in full.\n\n## The instrument that is not a survey\n\nMost small-business satisfaction surveys are answered by almost nobody and by an unrepresentative few of those. If you want a signal, keep it to one question, sent by the channel the customer already used, at the moment the thing was resolved:\n\n> *Did that sort it out? Yes / no*\n\nOne tap. Response rates are far higher than a five-question form, and the answer is the one you needed. Add an optional free-text box for the noes and read every one.\n\n## Before and after\n\nThe comparison only works if you measured before, which is the five-day tally applied to outcomes rather than to your own time.\n\nFor a fortnight before you change anything, count: enquiries received, how many were resolved in one exchange, how many came back, how many turned into business. Then run the change and count the same four for a fortnight.\n\nIf enquiries turn into business at the same rate but each takes you less time, that is a genuine win. If the rate falls while your time falls further, you have made a trade, and it might be the wrong one: a fast reply that loses one booking a week costs more than the hours it saved in most businesses.\n\n> Figure: A fortnight before, read against a fortnight after. A two by two grid, rows Your time per enquiry fell and Your time per enquiry held, columns Enquiry to outcome held and Enquiry to outcome fell: Your time per enquiry fell and Enquiry to outcome held: A genuine win. Report the hours with the outcome rate beside them.; Your time per enquiry fell and Enquiry to outcome fell: A trade, often the wrong one. A reply that loses a booking a week costs more than the hours it saved.; Your time per enquiry held and Enquiry to outcome held: Nothing changed. The tool is neither helping nor harming.; Your time per enquiry held and Enquiry to outcome fell: Faster at producing replies that generate a second message. Check repeat contact within 48 hours.. Response time improves immediately and means almost nothing on its own. Hours saved, reported with no outcome rate beside them, is exactly the number that lets a change which quietly costs you sales look like a success.\n\n## Read the actual conversations\n\nNumbers tell you something changed. Twenty transcripts tell you what.\n\nOnce a week, read twenty end to end: a mix of resolved, escalated and abandoned. Look for the sentence where it went wrong, the question you cannot answer, and the point where somebody gave up. Owners who do this find things no dashboard reports, and it takes twenty minutes.\n\n## The number to stop reporting\n\nTime saved, on its own, with no outcome attached.\n\n\"We save six hours a week\" is a statement about you, not about your customers, and it is exactly the number that lets a change that quietly costs you sales look like a success. Report it beside the outcome rate, or do not report it.\n\nThe question at the end of this block is the same one it opened with. The system got faster. Did anybody get served better?\n\n## Counting without a dashboard\n\nNone of this needs software. A spreadsheet with one row per enquiry and four columns (date, channel, resolved first time, outcome) takes about fifteen seconds a row and gives you every number in this lesson.\n\nDo it for a fortnight before a change and a fortnight after, then stop. This is a measurement exercise, not a permanent process, and businesses that try to track everything forever end up tracking nothing.\n\n## Who reads the numbers\n\nIn a business of two or three, the person who made the change is the worst reader of whether it worked, for the same reason they are the worst marker of their own prompt.\n\nShow the four numbers to somebody else with the before-and-after side by side and no commentary. If they reach the same conclusion you did, it is probably in the data. If you find yourself explaining why one of the numbers does not count, that is the number to look at hardest."},"check":{"question":"After introducing drafted replies, a business finds average response time down 70% and enquiry-to-booking unchanged. Repeat contact within 48 hours has risen from 8% to 19%. What is the most likely reading?","options":[{"text":"Faster replies have raised customer expectations, so people now follow up sooner about matters they would previously have left alone.","correct":false,"tempting":"Offers a benign explanation for the rise that does not account for why more customers need a second exchange about the same enquiry."},{"text":"Booking rate holding steady while response time fell shows the change is working, and the repeat contact figure reflects higher overall engagement.","correct":false,"tempting":"Reads two favourable numbers and reinterprets the unfavourable one as engagement, which is how a degradation gets reported as a success."},{"text":"The drafted replies are answering less completely, so more enquiries need a second exchange, and the unchanged booking rate is being sustained by that extra work rather than by the drafts.","correct":true},{"text":"The sample is too small to interpret, since a rise from 8% to 19% in a small business may represent only a handful of additional customers and could easily be ordinary week-to-week variation in the enquiry mix.","correct":false,"tempting":"Reasonable caution about small numbers, and it should prompt a longer look rather than a shrug, since the direction is the one a completeness problem predicts."}]},"prev":{"slug":"working-across-languages","title":"Serving customers in a language you do not read","url":"https://addaly.com/learn/ai-for-small-business/working-across-languages"},"next":{"slug":"listings-quotes-proposals","title":"Listings, Menus, Quotes and Proposals","url":"https://addaly.com/learn/ai-for-small-business/listings-quotes-proposals"},"authorship":"Founder and series editor: Dr Mustafa Mun. Written by AI models to a written standard. Exam keys checked blind by a second model: 3,665 of 3,666 agreed. Academic review invited.","review":{"status":"Draft, open for academic review"},"cite":"Addaly (2026) 'Did the customer actually get better service?', in AI for a Small Business. Edited by M. Mun. Addaly. Available at: https://addaly.com/learn/ai-for-small-business/measuring-service-not-speed (Accessed: 13 October 2026).","licence":{"name":"CC BY-NC-SA 4.0","url":"https://creativecommons.org/licenses/by-nc-sa/4.0/"},"reader":{"schema":1,"title":"Did the customer actually get better service?","courseTitle":"AI for a Small Business","module":{"index":4,"slug":"customers-and-the-front-desk","title":"Customers, from first message to resolved complaint"},"answer":null,"keyIdea":"Speed improves immediately and means little on its own, so measure first-contact resolution, repeat contact within 48 hours, enquiry-to-outcome and complaints about the service itself, and never report hours saved without the outcome rate beside it.","hero":{"kind":"figure","figure":{"t":"figure","label":"Figure","figure":{"cols":["Enquiry to outcome held","Enquiry to outcome fell"],"rows":["Your time per enquiry fell","Your time per enquiry held"],"type":"matrix","cells":[["A genuine win. Report the hours with the outcome rate beside them.","A trade, often the wrong one. A reply that loses a booking a week costs more than the hours it saved."],["Nothing changed. The tool is neither helping nor harming.","Faster at producing replies that generate a second message. Check repeat contact within 48 hours."]],"title":"A fortnight before, read against a fortnight after","caption":"Response time improves immediately and means almost nothing on its own. Hours saved, reported with no outcome rate beside them, is exactly the number that lets a change which quietly costs you sales look like a success.","cellLabels":[["keep it","look again"],["no effect","stop"]]},"alt":"Figure: A fortnight before, read against a fortnight after. A two by two grid, rows Your time per enquiry fell and Your time per enquiry held, columns Enquiry to outcome held and Enquiry to outcome fell: Your time per enquiry fell and Enquiry to outcome held: A genuine win. Report the hours with the outcome rate beside them.; Your time per enquiry fell and Enquiry to outcome fell: A trade, often the wrong one. A reply that loses a booking a week costs more than the hours it saved.; Your time per enquiry held and Enquiry to outcome held: Nothing changed. The tool is neither helping nor harming.; Your time per enquiry held and Enquiry to outcome fell: Faster at producing replies that generate a second message. Check repeat contact within 48 hours.. Response time improves immediately and means almost nothing on its own. Hours saved, reported with no outcome rate beside them, is exactly the number that lets a change which quietly costs you sales look like a success."}},"blocks":[{"t":"h2","id":"the-metric-that-flatters-everybody","runs":[{"text":"The metric that flatters everybody"}]},{"t":"p","runs":[{"text":"Response time is easy to measure, improves immediately, and is the first number every vendor reports. It is also nearly useless on its own, because a fast wrong answer is worse than a slow right one."}]},{"t":"p","runs":[{"text":"If you measure only speed, you will optimise for speed, and the system will get faster at producing replies that generate a second message from the same customer asking what you meant."}]},{"t":"h2","id":"four-numbers-that-mean-something","runs":[{"text":"Four numbers that mean something"}]},{"t":"p","runs":[{"text":"Resolution on first contact.","b":true},{"text":" Of the enquiries that arrived this week, what proportion were finished in one exchange? This is the honest measure of whether an answer answered. It is harder to count than response time and it is the one worth counting."}]},{"t":"p","runs":[{"text":"Repeat contact within 48 hours.","b":true},{"text":" The same customer coming back about the same thing. This rises when replies get faster and worse, and it is the clearest early warning that something has degraded. Watch it in the fortnight after any change."}]},{"t":"p","runs":[{"text":"Enquiry to outcome.","b":true},{"text":" Of the people who asked, how many booked, ordered or got what they came for? This is the number that connects the front desk to the business, and it is the one that tells you whether a change was worth making at all."}]},{"t":"p","runs":[{"text":"Complaints about the service itself.","b":true},{"text":" Not about the product: about being made to talk to a machine, or not being able to reach anybody. A small number, and each one is worth reading in full."}]},{"t":"h2","id":"the-instrument-that-is-not-a-survey","runs":[{"text":"The instrument that is not a survey"}]},{"t":"p","runs":[{"text":"Most small-business satisfaction surveys are answered by almost nobody and by an unrepresentative few of those. If you want a signal, keep it to one question, sent by the channel the customer already used, at the moment the thing was resolved:"}]},{"t":"quote","runs":[{"text":"Did that sort it out? Yes / no","i":true}]},{"t":"p","runs":[{"text":"One tap. Response rates are far higher than a five-question form, and the answer is the one you needed. Add an optional free-text box for the noes and read every one."}]},{"t":"h2","id":"before-and-after","runs":[{"text":"Before and after"}]},{"t":"p","runs":[{"text":"The comparison only works if you measured before, which is the five-day tally applied to outcomes rather than to your own time."}]},{"t":"p","runs":[{"text":"For a fortnight before you change anything, count: enquiries received, how many were resolved in one exchange, how many came back, how many turned into business. Then run the change and count the same four for a fortnight."}]},{"t":"p","runs":[{"text":"If enquiries turn into business at the same rate but each takes you less time, that is a genuine win. If the rate falls while your time falls further, you have made a trade, and it might be the wrong one: a fast reply that loses one booking a week costs more than the hours it saved in most businesses."}]},{"t":"h2","id":"read-the-actual-conversations","runs":[{"text":"Read the actual conversations"}]},{"t":"p","runs":[{"text":"Numbers tell you something changed. Twenty transcripts tell you what."}]},{"t":"p","runs":[{"text":"Once a week, read twenty end to end: a mix of resolved, escalated and abandoned. Look for the sentence where it went wrong, the question you cannot answer, and the point where somebody gave up. Owners who do this find things no dashboard reports, and it takes twenty minutes."}]},{"t":"h2","id":"the-number-to-stop-reporting","runs":[{"text":"The number to stop reporting"}]},{"t":"p","runs":[{"text":"Time saved, on its own, with no outcome attached."}]},{"t":"p","runs":[{"text":"“We save six hours a week” is a statement about you, not about your customers, and it is exactly the number that lets a change that quietly costs you sales look like a success. Report it beside the outcome rate, or do not report it."}]},{"t":"p","runs":[{"text":"The question at the end of this block is the same one it opened with. The system got faster. Did anybody get served better?"}]},{"t":"h2","id":"counting-without-a-dashboard","runs":[{"text":"Counting without a dashboard"}]},{"t":"p","runs":[{"text":"None of this needs software. A spreadsheet with one row per enquiry and four columns (date, channel, resolved first time, outcome) takes about fifteen seconds a row and gives you every number in this lesson."}]},{"t":"p","runs":[{"text":"Do it for a fortnight before a change and a fortnight after, then stop. This is a measurement exercise, not a permanent process, and businesses that try to track everything forever end up tracking nothing."}]},{"t":"h2","id":"who-reads-the-numbers","runs":[{"text":"Who reads the numbers"}]},{"t":"p","runs":[{"text":"In a business of two or three, the person who made the change is the worst reader of whether it worked, for the same reason they are the worst marker of their own prompt."}]},{"t":"p","runs":[{"text":"Show the four numbers to somebody else with the before-and-after side by side and no commentary. If they reach the same conclusion you did, it is probably in the data. If you find yourself explaining why one of the numbers does not count, that is the number to look at hardest."}]}],"check":{"question":[{"text":"After introducing drafted replies, a business finds average response time down 70% and enquiry-to-booking unchanged. Repeat contact within 48 hours has risen from 8% to 19%. What is the most likely reading?"}],"options":[{"text":[{"text":"Faster replies have raised customer expectations, so people now follow up sooner about matters they would previously have left alone."}],"correct":false,"tempting":[{"text":"Offers a benign explanation for the rise that does not account for why more customers need a second exchange about the same enquiry."}]},{"text":[{"text":"Booking rate holding steady while response time fell shows the change is working, and the repeat contact figure reflects higher overall engagement."}],"correct":false,"tempting":[{"text":"Reads two favourable numbers and reinterprets the unfavourable one as engagement, which is how a degradation gets reported as a success."}]},{"text":[{"text":"The drafted replies are answering less completely, so more enquiries need a second exchange, and the unchanged booking rate is being sustained by that extra work rather than by the drafts."}],"correct":true,"tempting":null},{"text":[{"text":"The sample is too small to interpret, since a rise from 8% to 19% in a small business may represent only a handful of additional customers and could easily be ordinary week-to-week variation in the enquiry mix."}],"correct":false,"tempting":[{"text":"Reasonable caution about small numbers, and it should prompt a longer look rather than a shrug, since the direction is the one a completeness problem predicts."}]}],"order":[3,1,2,0],"why":null},"prev":{"slug":"working-across-languages","title":"Serving customers in a language you do not read","minutes":9},"next":{"slug":"listings-quotes-proposals","title":"Listings, Menus, Quotes and Proposals","minutes":8}}}