Evaluate both disparity and delay before adjusting: What should the agency do?
Monitor mitigation benefits and unintended impacts together before deciding whether refinement, replacement, or fallback is warranted.
The question
A public-benefit agency introduces a mitigation that reduces unequal referral rates in testing. Three months later, monitoring shows referral parity remains improved, but processing delays have increased for one subgroup. What should the agency do?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Keep the mitigation because the original disparity improved.Improved parity does not resolve a newly observed subgroup delay that may represent another harmful impact requiring evaluation.
- Transfer all referrals to manual review until parity persists.Manual review may be a fallback, but the evidence does not establish that universal transfer is necessary or operationally suitable.
- Evaluate both disparity and delay before adjusting controls. ✓Mitigation effectiveness requires monitoring intended benefits alongside new impacts, followed by evidence-based adjustment and documented residual risk.
- Remove the mitigation to restore prior processing speed.Removing a control may reinstate the original disparity without establishing that the delay cannot be reduced through refinement.
The trap
Successful movement on one metric does not close monitoring when another subgroup impact emerges. How to remember it
Monitor mitigation benefits and unintended impacts together before deciding whether refinement, replacement, or fallback is warranted.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Disclose the model’s handwritten-form limitations: What should the insurer request before deployment? →
- Document the update: What should the provider do first? →
- The integrated system needs contextual security testing: What does this evidence most directly support? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.