Obtain access to linked model: Which evidence should the team obtain?
Obtain the linked underlying artifacts and access needed to reconstruct the exact evaluation.
The question
An internal employee-assistance model was approved using a metric report, but reviewers cannot reproduce it. The report omits the transformed-data version, model artifact identifier, and exact held-out split. Approval requires reproducibility and meaningful evaluation. Which evidence should the team obtain?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Request a newer scoreA newer score remains unverifiable if the model, transformed data, and held-out evaluation split cannot be identified and accessed.
- Recompute subgroup metrics on a documented fresh splitFresh metrics may be useful, but they do not establish what produced the original report and may not preserve the required held-out evaluation design.
- Obtain access to linked model, data, transformation, split, and metric artifacts ✓Access to the linked underlying artifacts, not merely their identifiers, permits reconstruction of the exact evaluation and examination of its held-out design.
- Review the data dictionary and retention scheduleThese documents clarify data meaning and governance, but they do not reproduce the specific model evaluation or identify its split and transformations.
The trap
When a result cannot be reproduced, require both linked lineage and access to the underlying evaluation artifacts. How to remember it
Obtain the linked underlying artifacts and access needed to reconstruct the exact evaluation.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Adjudicate a stratified disagreement sample using: Which evidence most directly resolves that uncertainty? →
- Test targeted rare failure scenarios: Which evidence best addresses this risk before purchase? →
- Require source records: Which approach satisfies that constraint? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
