Track subgroup outcomes over time: Which control most directly addresses the concern?
Tracking subgroup outcomes over time directly tests whether the feedback loop is amplifying historical disparities.
The question
A school-district scheduling tool assigns intervention resources using historical referral patterns. Testing, oversight, supplier review, and risk documentation are complete. Over time, assignments generate new referrals that reinforce earlier disparities, yet monitoring tracks only overall assignment accuracy. Which control most directly addresses the concern?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Ask teachers to approve every assignment.Teacher approval may add oversight, but without subgroup outcome evidence it may not reveal or correct systematic reinforcement patterns.
- Replace historical features with synthetic referrals.Synthetic data may preserve existing bias or introduce leakage, and replacing features does not itself demonstrate improved subgroup outcomes.
- Increase overall accuracy testing.Overall accuracy can remain strong while subgroup disparities worsen, so aggregate testing does not directly assess the feedback-loop concern.
- Track subgroup outcomes over time. ✓Subgroup outcome monitoring can reveal whether feedback-driven referrals amplify historical disparities that aggregate accuracy conceals.
The trap
For feedback loops, monitor evolving subgroup outcomes, not only initial model accuracy or aggregate performance. How to remember it
Tracking subgroup outcomes over time directly tests whether the feedback loop is amplifying historical disparities.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Log near misses with owners and corrective actions: Which missing control best addresses this gap? →
- Document owner: Which control best resolves both constraints? →
- Map dependencies before decommissioning: What is the most direct missing control? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.