Impacts on non-users and underrepresented groups: Which remaining risk should assessment address?
Consent and enrolled-student accuracy do not resolve effects on non-users or groups absent from training evidence.
The question
A school district uses an AI model to predict attendance and allocate outreach resources. It obtains consent from enrolled students’ guardians and measures enrolled-student accuracy. Community groups report effects on siblings, caregivers, and students not represented in the training data. Which remaining risk should assessment address?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Higher predictive accuracy among enrolled students.Improved enrolled-student accuracy does not establish safety, fairness, or effects for people outside the measured population.
- Impacts on non-users and underrepresented groups. ✓People outside the direct user group may experience resource, stigma, or access effects, while missing representation limits the model’s contextual validity.
- More frequent dashboard refreshes for administrators.Fresher dashboards may help operations, but they do not assess effects on non-users or limitations created by unrepresented populations.
- Additional consent from currently enrolled families.Additional consent may address participation concerns, but it does not evaluate impacts on siblings, caregivers, or excluded students.
The trap
List people affected by outputs or resource allocation, not merely people operating or directly participating in the system. How to remember it
Consent and enrolled-student accuracy do not resolve effects on non-users or groups absent from training evidence.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Complex or underserved customers may face delayed human: What is the key remaining risk? →
- Prioritize the severe holiday impact: How should the remaining risk be prioritized? →
- Retain treatment and monitor severe misuse pathways: Which governance conclusion is most defensible? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.