The disclosure omits operational limitations and supplier: Which disclosure deficiency most directly threatens
Benchmark accuracy cannot substitute for failure conditions, limitations, and assigned supplier responsibilities.
The question
A vendor supplies a document-processing model for a bank’s internal financial records. Its disclosure reports benchmark accuracy and training-data categories but does not state known failure conditions, output limitations, or who handles updates and incidents. Which disclosure deficiency most directly threatens the bank’s control design?
Preparing for AIGP? Take the free 5-min readiness quiz →
- The bank lacks evidence that benchmark performance generalizes to every department.Contextual testing may be needed, but this does not identify the specific operational information missing from the vendor disclosure.
- The disclosure uses benchmark results instead of a formal certification.A certification would not necessarily provide the use-case-specific limitations and responsibility information needed for controls.
- The bank lacks a banking-regulator approval for using the vendor model.The facts establish no such approval requirement. The issue is incomplete operational information, not regulatory authorization.
- The disclosure omits operational limitations and supplier responsibilities. ✓Benchmark results and training-data categories do not tell the bank how the model can fail, where outputs are limited, or who handles updates and incidents.
The trap
Look for operational limits and responsibility boundaries, not merely performance claims. How to remember it
Benchmark accuracy cannot substitute for failure conditions, limitations, and assigned supplier responsibilities.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Rollback may misread the current schema: What specific risk remains? →
- Aggregate data can hide subgroup harm: What specific risk remains? →
- The supplier update may perform differently: What remaining risk is most specific? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.