Conduct security testing alongside targeted robustness: Which plan is most defensible?
Combine security testing with targeted robustness checks because performance validation cannot address manipulation and exposure risks.
The question
A hospital administration team deploys a model that routes records for nonclinical scheduling review. Accuracy testing is complete, but reviewers have not examined prompt-based manipulation or unauthorized data exposure. Approval requires evidence addressing these different uncertainties. Which plan is most defensible?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Benchmark routing accuracy against another scheduling modelBenchmarking compares performance, yet does not establish resistance to manipulation or protection against unauthorized data exposure.
- Conduct security testing alongside targeted robustness checks ✓Security testing addresses manipulation and exposure, while targeted robustness checks examine behavior under abnormal or adversarial inputs.
- Ask scheduling staff to review representative outputsStaff review can identify usability or ordinary quality issues, but is insufficient for systematic manipulation and exposure testing.
- Repeat accuracy testing on a larger sampleA larger accuracy sample addresses performance precision, but not prompt manipulation or unauthorized data exposure.
The trap
Match each uncertainty to its evidence type; accuracy results do not answer security questions. How to remember it
Combine security testing with targeted robustness checks because performance validation cannot address manipulation and exposure risks.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Control false negatives: Which evidence should receive priority before approval? →
- Test re-identification risk and real-image subgroup: Before approval, which evidence is most important? →
- Adjudicate a stratified disagreement sample using: Which evidence most directly resolves that uncertainty? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
