Link model, dataset, transformation, and test versions: What control most directly resolves the uncertainty?
Version-linked lineage connects the evaluated model to exact data and transformations, enabling reproducibility and interpretation.
The question
An insurance operations report evaluates model version 2 using a dataset identified only as “claims history.” The engineering team later discovers several transformed dataset versions and cannot determine which one trained the model or generated the test results. What control most directly resolves the uncertainty?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Increase the report’s aggregate performance detail using current metricsMore metric detail cannot identify the undocumented artifacts underlying the existing model and evaluation.
- Link model, dataset, transformation, and test versions in lineage records ✓Version-linked lineage identifies the exact training and test artifacts, transformations, and model needed to reproduce the evaluation.
- Replace transformed data with raw claims records for future trainingRaw records may not be appropriate and replacement does not document the versions already used for the reported result.
- Repeat testing on the latest available claims dataRetesting may produce new results but does not establish which prior data and transformations produced the reported model.
The trap
A reproducible evaluation requires linked versions, not merely a dataset title or a model release number. How to remember it
Version-linked lineage connects the evaluated model to exact data and transformations, enabling reproducibility and interpretation.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Clarify criteria: What evidence should it prioritize before interpreting model performance? →
- Use targeted rare-case testing: Which evaluation response best addresses both rarity and consequence? →
- Document data lineage for training and testing artifacts: What evidence should be required before approval? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
