Resolve or control the finding: What should the release decision prioritize?
Red-team findings require mitigation or controlled acceptance before release; passing ordinary accuracy tests does not settle adversarial risk.
The question
Before releasing an employment-screening model, a red-team exercise finds a plausible prompt or input pattern that could produce systematically misleading recommendations. Standard accuracy tests passed. What should the release decision prioritize?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Restrict testing to the subgroup showing the clearest adverse pattern.Narrow testing may characterize one affected subgroup but does not determine whether the broader exploit is controlled before release.
- Release because standard validation already met its acceptance threshold.Standard validation does not cover every misuse or application risk, and red teaming complements ordinary validation.
- Record the finding for the next scheduled model review.Deferring a known plausible failure leaves an identified deployment risk untreated despite successful ordinary accuracy testing.
- Resolve or control the finding, then reassess release evidence. ✓A plausible red-team failure should receive mitigation and documented reassessment because routine validation cannot establish absence of such risk.
The trap
Passing accuracy tests does not negate a credible misuse, robustness, or subgroup failure discovered separately. How to remember it
Red-team findings require mitigation or controlled acceptance before release; passing ordinary accuracy tests does not settle adversarial risk.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Revalidate the changed version for the intended use: What is the decisive requirement before deployment? →
- Contain affected processing while investigating the cause: What should the response team do first? →
- Verify current-record compatibility and rollback path: What must precede restoring the prior release? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.