The undocumented lineage prevents reliable provenance: What do these contrasting observations support?
Accuracy supports observed performance only; absent lineage prevents a dependable provenance and suitability assessment.
The question
A customer-service team reports that its model was trained on “all available conversations,” yet cannot identify collection sources, filtering steps, transformations, or dataset versions. A separate audit finds strong held-out accuracy. What do these contrasting observations support?
Preparing for AIGP? Take the free 5-min readiness quiz →
- The accuracy result establishes complete data suitability.Strong held-out accuracy does not establish provenance, completeness, representativeness, or suitability for every intended use.
- The volume makes further data review unnecessary.Large volume does not guarantee fitness, and undocumented preparation can conceal sampling, duplication, or transformation limitations.
- The test score proves customer conversations were representative.A test score reflects selected evaluation data; it cannot by itself show representation of the deployment population or use conditions.
- The undocumented lineage prevents reliable provenance assessment. ✓Missing origins, transformations, and versions prevent reviewers from evaluating how the data was formed and whether results remain traceable.
The trap
Separate what a metric demonstrates from what undocumented data history leaves unknown. How to remember it
Accuracy supports observed performance only; absent lineage prevents a dependable provenance and suitability assessment.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Create targeted tests for the rare severe condition: Which additional control most directly addresses this →
- Urban-rural performance is comparable in this test set: What does the evidence most directly show? →
- Accuracy is unestablished for affected seasonal products: What does this evidence most directly support? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
