Escalate the rare safety-critical miss: What should governance do?
Governance must escalate a rare failure when its consequence is safety-critical, regardless of its low observed frequency.
The question
A manufacturing quality model inspects components, and a missed defect is unlikely but could cause a serious equipment failure. The plant’s risk policy requires escalation of hazards with severe consequences even when infrequent. What should governance do?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Approve deployment after confirming overall defect accuracy.Aggregate accuracy may conceal rare safety-critical failures and therefore cannot satisfy the stated escalation requirement.
- Rank defects by their average monthly count.Counts can inform monitoring, but average frequency conflicts with the policy’s emphasis on severe consequences.
- Escalate the rare safety-critical miss. ✓The policy explicitly requires escalation when consequences are severe, so low frequency does not justify treating this miss as routine.
- Compare the missed defect with ordinary rework costs.Cost comparison may support prioritization, but the policy requires escalation based on hazard severity, not routine expense.
The trap
Look for consequential edge cases hidden by averages or frequency-based summaries. How to remember it
Governance must escalate a rare failure when its consequence is safety-critical, regardless of its low observed frequency.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Prioritize high-severity harms even when their likelihood: Which risk should receive priority? →
- Risk-acceptance criteria and delegated authority: What should the team establish before deciding whether to →
- The business resolution metric adequately represents: Which prior assumption no longer holds? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.