A baseline of current service outcomes: What evidence should precede approval of the replacement?
A current-service baseline is necessary to test whether replacement improves outcomes rather than merely changing the workflow.
The question
An employer wants to replace an internal employee-help desk with a generative assistant. Management claims the assistant will reduce handling time, but has no reliable measure of current resolution time, escalation frequency, or employee satisfaction. What evidence should precede approval of the replacement?
Preparing for AIGP? Take the free 5-min readiness quiz →
- A rollout plan with employee communicationsCommunication supports implementation, but approval first requires evidence about the existing process and the replacement’s intended benefits and costs.
- A baseline of current service outcomes ✓A current-state baseline enables meaningful comparison of resolution time, escalations, satisfaction, and impacts after deployment.
- A supplier benchmark from unrelated support teamsExternal results may indicate potential, but they cannot substitute for measurements of this organization’s users, workflow, and impacts.
- A larger language model selected for broad capabilityModel capability does not establish whether replacement improves this organization’s workflow or preserves important service outcomes.
The trap
When AI replaces a workflow, ask what current-state evidence makes improvement and harm measurable. How to remember it
A current-service baseline is necessary to test whether replacement improves outcomes rather than merely changing the workflow.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Deployment and Use questions
- Sandboxed adversarial traces with approval logs: Before approval, which evidence most directly resolves that →
- Observed review of representative patches: Which evidence best addresses readiness? →
- Validate locally with representative populations: Which evidence should resolve the uncertainty? →
- All 424 Understanding How to Govern AI Deployment and Use questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Deployment and Use ·
Every answer, right and wrong, comes with its own explanation.