Measure customer resolution and repeat-contact rates: Which evidence best tests the affected-person outcome
Resolution and repeat-contact measures reveal customer outcomes that handling-time metrics can conceal.
The question
A customer-service chatbot lowers average handling time, but some customers report unresolved issues after interacting with it. Which evidence best tests the affected-person outcome rather than only the business metric?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Measure customer resolution and repeat-contact rates. ✓Resolution and repeat-contact rates show whether customers’ problems were addressed, directly testing the affected-person outcome.
- Compare chatbot infrastructure costs with staffing costs.Cost comparisons inform organizational efficiency, but they do not show whether affected customers receive effective issue resolution.
- Measure average conversation duration by team.Conversation duration is another operational efficiency metric and may improve while customers still leave with unresolved problems.
- Report aggregate chatbot accuracy on test conversations.Test accuracy may indicate technical validity but cannot establish whether real customers’ issues were resolved during service interactions.
The trap
Ask whether the measure describes organizational operations or what affected people actually experience. How to remember it
Resolution and repeat-contact measures reveal customer outcomes that handling-time metrics can conceal.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- A predefined risk acceptance criterion: What does the threshold represent in this decision? →
- Test staffed override: At design time, which evidence best resolves whether human fallback is genuinely →
- Documented stakeholder evidence that local stockouts are: Which evidence should determine whether the →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.