Sample subgroup decisions: Which choice best addresses incomplete evidence while enabling action before
Use targeted subgroup sampling and outcome validation, with thresholds linking disparities to escalation.
The question
For an EU employment-screening deployment subject to applicable EU AI Act obligations and the organization’s internal monitoring policy, a vendor supplies drift alerts, but subgroup outcome labels are incomplete and renewal decisions are near. The team can fund one monitoring approach. Which choice best addresses incomplete evidence while enabling action before renewal?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Use vendor drift alerts as the interim control.Drift alerts identify distribution changes but do not validate subgroup outcomes or show whether screening impacts are acceptable.
- Sample subgroup decisions, validate outcomes, and escalate material disparities. ✓Targeted sampling and outcome validation address incomplete labels, while defined escalation enables timely intervention before renewal.
- Wait for complete historical labels before evaluating subgroup outcomes.Deferring review delays risk treatment; suitable sampling and documented uncertainty can produce useful interim evidence.
- Compare aggregate accuracy using available outcomes each quarter.Aggregate accuracy can conceal subgroup disparities, and quarterly comparison may not provide actionable evidence before renewal.
The trap
Separate detecting distribution changes from validating outcomes, and connect impacts to response authority. How to remember it
Use targeted subgroup sampling and outcome validation, with thresholds linking disparities to escalation.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Obtain use-case limits: What should the buyer require? →
- Test the update against claims-specific acceptance: Before enabling the update, which action best satisfies →
- Block release and restore the prior security baseline: Which action is most appropriate? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
