Define and validate an independent administrative target: Which control is most direct?
Historical decisions may encode unequal access; an independently justified administrative target should replace unexamined decisions as labels.
The question
A medical administration system, not a clinical-advice tool, predicts which appointment requests historically received expedited handling. Historical decisions reflect unequal access to clinicians, and several records lack outcome details. Other privacy, provenance, testing, and monitoring prerequisites are satisfied. Which control is most direct?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Tune thresholds using historical approval ratesThreshold tuning changes operating points but preserves the potentially biased historical decision target and incomplete outcome information.
- Define and validate an independent administrative target ✓An independently justified target, validated against appropriate records, reduces reliance on historically biased decisions as the learning label.
- Measure average prediction accuracy over timeAverage accuracy can reward reproduction of historical decisions without showing whether those decisions represent fair administrative outcomes.
- Add more historical decision recordsAdditional historical decisions could reinforce unequal access patterns and do not establish whether the target reflects an appropriate administrative outcome.
The trap
When labels come from unequal historical decisions, question the target itself before tuning models or adding data. How to remember it
Historical decisions may encode unequal access; an independently justified administrative target should replace unexamined decisions as labels.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Build an adjudicated: Which control most directly addresses both constraints before model training? →
- Test proxy effects and revise affected features: Which control most directly addresses the concern? →
- Keep training and test records separate: Which missing control is most direct before relying on the reported →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
