Test across representative conditions: Which control most directly addresses the reliability concern?
A single small sample cannot establish reliability; testing must cover representative populations and conditions.
The question
A public-benefit classifier labels one eligibility sample correctly at a high rate. The sample is small and does not represent seasonal applicants or language groups. All other prerequisites are satisfied. Which control most directly addresses the reliability concern?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Publish the sample accuracy rate.Publishing the rate improves transparency but does not establish performance for omitted seasons or language groups.
- Use the same sample for threshold tuning.Reusing the limited sample may optimize apparent performance without showing generalization to omitted applicants and conditions.
- Explain every classification to applicants.Explanations may assist applicants, but they do not supply missing evidence about reliability across populations and conditions.
- Test across representative conditions. ✓Reliability requires evidence across relevant populations and conditions, not confidence based on one small, unrepresentative sample.
The trap
Do not infer reliability from one sample; inspect representativeness, conditions, and generalization evidence. How to remember it
A single small sample cannot establish reliability; testing must cover representative populations and conditions.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding the Foundations of AI Governance questions
- Audit group-level impacts alongside individual accuracy: Which control best addresses the primary governance →
- Show the key inputs and their decision influence: Which additional control most directly addresses the →
- Test hazards and block unsafe sequences before execution: Which additional control most directly addresses the →
- All 337 Understanding the Foundations of AI Governance questions →
Part of the Certsqill AIGP question bank · Understanding the Foundations of AI Governance ·
Every answer, right and wrong, comes with its own explanation.