Define acceptance criteria before reviewing results: What should it do first?
Set the acceptance threshold before interpreting validation results to avoid post hoc risk tolerance.
The question
Before deploying an AI ranking tool for hiring in an EU workplace, an employer plans to review validation results but has not defined when residual risk is acceptable. What should it do first?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Use the supplier's default acceptance threshold.A supplier's threshold may reflect another context and does not establish the employer's own legal, fairness, reliability, or harm criteria.
- Define acceptance criteria before reviewing results. ✓Predefined criteria reduce the risk that favorable results will cause the employer to relax its threshold for acceptable employment-related risk.
- Ask hiring managers whether rankings seem useful.Perceived usefulness does not show that residual risks satisfy predefined employment, fairness, or reliability requirements.
- Select the threshold with the best validation score.Choosing the standard after seeing the results permits favorable evidence to determine what risk will be tolerated.
The trap
Check whether the decision rule existed before the team saw the performance results. How to remember it
Set the acceptance threshold before interpreting validation results to avoid post hoc risk tolerance.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Assess severity: What should guide the acceptance decision? →
- Claimant outcomes and distribution of delays: Which outcome should governance examine first? →
- Provide an authorized: Which design decision is most defensible? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.