Obtain change records: Which evidence should the agency obtain?
Obtain version documentation, deployment-specific regression tests, and clearly assigned supplier and agency responsibilities.
The question
A public-benefit agency uses a supplier’s eligibility model. The supplier announces a model update, but the agency has no clear record of changed training data, version behavior, or incident contacts. Continued use requires controlling update risk before the new version enters production. Which evidence should the agency obtain?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Review a new general benchmark score for the updated model.A benchmark score does not reveal changes affecting the agency’s population, workflow, or operational responsibilities.
- Obtain a warranty that the update preserves prior performance across agency eligibility cases and workflows.A warranty provides assurance or contractual allocation, but it does not provide testable evidence about changed inputs, behavior, or reporting duties.
- Request the supplier’s revised release notes.Release notes may summarize changes but may not establish deployment-specific behavior, limitations, ownership, or incident handling.
- Obtain change records, agency regression tests, limitations, owners, and incident contacts. ✓Together these establish what changed, whether the agency’s workflow remains suitable, and who manages resulting risks.
The trap
For supplier changes, connect technical regression evidence with documented responsibilities and incident channels. How to remember it
Obtain version documentation, deployment-specific regression tests, and clearly assigned supplier and agency responsibilities.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Measure comparable subgroup outcomes before and after: Which evidence is most probative? →
- Run targeted access-control and data-exposure tests: Before approval, which evidence best addresses the →
- Maintain structured near-miss records with context: Before expansion, what evidence should governance require? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
