← Forums

Two AI support agents scored 101/102. Which mistake would you fix first?

It’s Friday at five. In one replay of the shift, a customer checks her shop balance. The $40 she was promised is missing. In the other replay, she gets her $40 on time. A man who returned one lamp finds two $40 credits on his balance.

Before the next shift, you can change how one desk handles refunds. Would you stop a second credit for the same return, or make sure an approved credit reaches the customer by the promised time?

Open the two order records

These are two runs of the same fictional shop. Customers opted for store credit, so they can see a refund as soon as the shop posts it. Each desk answered the same 100 delivery questions correctly. Two more messages came in.

Order 41. “Where’s the refund for my lamp?” The $40 lamp came from a $120 order. The original $40 credit is already on the customer’s balance. Desk A adds another $40. Desk B finds the first entry and tells the customer where to see it.

Order 62. A different customer was promised $40 by Friday at 5 p.m. Desk A posts the credit at 5. Desk B marks the request approved. Its credit finally appears on the customer’s balance at 1 a.m. Saturday.

Each desk handled 101 of 102 cases correctly. Desk A cost the shop an extra $40. Desk B kept a customer waiting eight hours past the promise. Pick the first fix. Now change just one entry in Desk B’s record. The credit appears at 5 p.m. Sunday. Does your choice change?

Where would you switch?

Muhammad Afnan asked how to set the weights for an unchecked refund. I’d start by asking the person who owns these two outcomes a smaller question. How late would the second refund have to be for it to feel as serious as issuing the extra $40? Muhammad’s original question

Give the duplicate 40 penalty points. For a cutoff above zero, divide 40 by your cutoff in hours to get a flat penalty for each overdue hour. A 20-hour cutoff gives two points an hour. Eight hours scores 16, so fix the duplicate first. Forty-eight hours scores 96, so fix the late credit first.

You might say a second credit for the same return always stops release. Put that rule above the score. You can still give someone the late customer’s order number and ask them to get the credit through. The 100 clean delivery replies change neither balance.

What did the customer have to do?

In a case reviewed by the Housing Ombudsman, a resident expected a rent refund on January 13. She followed up on January 16, 18 and 23. She received it on February 18. That’s something a support desk can count without guessing the price of an hour of her time. Ombudsman’s findings, paragraph 20

For your next test, put the promised time, the time the customer could actually use the money, and the number of times they had to ask again beside the score. If you test card refunds, also keep the time the shop sent the request. A bank can post the credit later. How Stripe traces a refund

Try your own cutoff

Choose the delay that would change your mind, or write down the rule that keeps your answer the same. The editable practice scorecard starts with both orders. You can change the description before building. Building in Maker takes the $25 monthly Make plan.

Make a practice scorecard for a fictional shop. Give two AI support desks the same 102 cases. Both answer 100 delivery questions correctly. Order 41 includes one returned $40 lamp from a $120 order. Its credit already exists. Desk A issues the same $40 again. Desk B finds the first entry. Another customer, order 62, is owed $40 in store credit by Friday at 5 p.m. Desk A credits it on time. Desk B credits it 8 hours late. Show both ledgers, the promised time and when the balance changed. Ask which desk I would change for the next shift. Change only the delay to 48 hours and ask again. Let me make a duplicate a release blocker or choose a positive delay as serious as a $40 duplicate. Show my weights and scores for both runs alongside the dollars, overdue hours and any reported repeat contacts. Keep my reasons. Use fictional records throughout.

If you try the two waits, which fix did you choose at eight hours and at two days? The most interesting part is the rule you used.

0
0

0 comments

No comments yet. Start the conversation.