Revalidate in the actual context: What is the strongest decision?
Revalidate the changed version with representative subgroups in the actual housing-administration context.
The question
A housing-application administration system is being upgraded from model version 3.1 to 3.2. The vendor reports improved average accuracy, but provides no subgroup results for a newly served applicant population. Because both the version and population changed, release approval requires deployment-relevant evidence. What is the strongest decision?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Retain version 3.1 until the annual governance review.Waiting for a calendar review delays evidence gathering and does not determine whether version 3.2 is suitable for the changed population.
- Pilot 3.2 with applicants without documenting uncertainty or subgroup results.A pilot may generate useful evidence, but omitting subgroup evidence and uncertainty documentation prevents accountable interpretation of the release risk.
- Revalidate in the actual context. ✓Testing version 3.2 with representative applicant subgroups, conditions, acceptance criteria, and documented uncertainty addresses the changed deployment context.
- Approve on average accuracy.An aggregate vendor metric does not show performance for the newly served population or reveal subgroup-specific reliability and fairness limitations.
The trap
A supplier improvement claim is scoped evidence; require deployment-specific subgroup testing. How to remember it
Revalidate the changed version with representative subgroups in the actual housing-administration context.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Trigger targeted revalidation for the changed traveler: What should govern the next decision? →
- Remediate the finding and pass a retest: What should happen next? →
- Activate containment while preserving evidence: What is the immediate governance action? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.