Replace choices with independently defined suitability: Which approach is appropriate?
Use independently defined suitability outcomes, then test performance across worker groups.
The question
A logistics company wants to train a scheduling model on historical dispatcher choices. Reviewers find that past choices systematically gave less flexible routes to one worker group, and approval requires labels representing operational suitability rather than prior preference. Which approach is appropriate?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Replace choices with independently defined suitability outcomes and test groups. ✓Independent outcomes align labels with operational suitability, while subgroup testing checks whether resulting performance remains uneven.
- Balance historical choices across groups while preserving the original target labels.Rebalancing frequencies does not correct the underlying meaning of labels that reflect biased preferences rather than suitability.
- Train directly on historical dispatcher choices.Unadjusted choices encode the identified allocation pattern and may teach the model to reproduce unequal treatment.
- Add worker-group indicators so the model can calibrate historical dispatcher preferences.Group indicators can preserve or formalize the biased decision rule and do not create suitability-based labels.
The trap
If past decisions reflect unequal practice, examine what the label represents before treating it as ground truth. How to remember it
Use independently defined suitability outcomes, then test performance across worker groups.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Investigate missingness and add targeted labels: Which approach fits? →
- Exclude the proxy and validate subgroup performance: Which approach meets the condition? →
- Use a representative: Which approach satisfies that requirement? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.