Audit and improve label quality: Which mitigation best addresses the immediate evidence gap?
Inconsistent and missing defect labels undermine evaluation; improving label validity is more immediate than adding data or model complexity.
The question
A manufacturer trains a defect classifier from inspection records, but many records lack confirmed defect labels and inspectors used inconsistent criteria. Which mitigation best addresses the immediate evidence gap?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Audit and improve label quality. ✓Confirmed, consistently defined labels are necessary to evaluate whether predictions correspond to actual manufacturing defects.
- Increase model complexity.Greater complexity cannot repair missing or inconsistent labels and may obscure whether apparent performance reflects reliable defect information.
- Report confidence intervals only.Statistical uncertainty estimates cannot correct systematic label inconsistency or reveal whether the measured target is valid.
- Add unlabeled production images.Additional unlabeled images may broaden exposure, but they do not resolve uncertainty about the target outcome used for evaluation.
The trap
Before trusting metrics, verify that the outcome labels are sufficiently complete, consistent, and meaningful. How to remember it
Inconsistent and missing defect labels undermine evaluation; improving label validity is more immediate than adding data or model complexity.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Evaluate rural pediatric records before deployment: Which proposed mitigation leaves the decisive risk? →
- Revalidate labels against document requirements: Which mitigation addresses the remaining risk most directly? →
- Test subgroup outcomes and inspect correlated inputs: Which mitigation best addresses the remaining risk? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.