A monitoring signal requiring accuracy investigation: What does the complaint primarily represent?
A repeated accuracy complaint is post-deployment evidence about impact, not merely an operational service comment.
The question
A public-benefit office receives a complaint that an AI assistant repeatedly gives confident but incorrect explanations of eligibility. Staff had been monitoring uptime and response volume, but not answer accuracy. What does the complaint primarily represent?
Preparing for AIGP? Take the free 5-min readiness quiz →
- A monitoring signal requiring accuracy investigation and corrective action. ✓The complaint supplies post-deployment evidence about confabulation and should inform investigation, corrective action, and ongoing monitoring.
- A user-experience issue separate from post-deployment monitoring.User complaints are relevant monitoring inputs because they reveal actual system impacts missed by operational metrics.
- Evidence that every automated eligibility decision is unlawful.The complaint indicates possible answer-quality harm, but does not establish legal conclusions about every automated decision.
- A routine service-quality comment requiring no model review.Repeated incorrect explanations are an impact signal requiring investigation, not merely a routine service-quality observation.
The trap
Treat repeated user-reported harms as monitoring evidence, especially when existing metrics omit answer quality. How to remember it
A repeated accuracy complaint is post-deployment evidence about impact, not merely an operational service comment.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Deployment and Use questions
- Generated fluency is not verified evidence: What distinction must training establish? →
- Meaningful human oversight capacity: What requirement is decisively unmet? →
- Treat the shift as a warning: Which distinction should govern the next decision? →
- All 424 Understanding How to Govern AI Deployment and Use questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Deployment and Use ·
Every answer, right and wrong, comes with its own explanation.