Document data lineage for training and testing artifacts: What evidence should be required before approval?
Require lineage records covering sources, transformations, periods, and versions.
The question
A logistics scheduler uses data from several vendors. The team knows the data were cleaned and merged, but cannot identify the original sources, transformations, collection periods, or exact dataset version used in testing. What evidence should be required before approval?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Rerun the evaluation on the merged datasetA rerun may update performance results but leaves the dataset’s origins, transformations, periods, and version uncertain.
- Document data lineage for training and testing artifacts ✓Source, transformation, time-period, and version records directly resolve each stated provenance gap and support reproducible evaluation.
- Benchmark the scheduler against another systemA benchmark may show relative performance but cannot establish the evaluated data’s origin, processing history, or version.
- Acquire additional records from the same vendorsMore records do not identify the history or exact version of the data already used for testing.
The trap
Match evidence to the uncertainty: provenance questions require lineage, not merely new performance measurements. How to remember it
Require lineage records covering sources, transformations, periods, and versions.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Use targeted rare-case testing: Which evaluation response best addresses both rarity and consequence? →
- Compare training distributions with deployment conditions: Which evidence most directly resolves that →
- Audit label completeness and department coverage: Before approval, which evidence best addresses both →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.