Substantiate accuracy across the advertised population: What control is most directly missing under
The accuracy claim exceeds the tested scope; substantiation must match the advertised population and conditions.
The question
A US education-administration vendor advertises that its AI placement tool is “98% accurate.” Internal testing covered one district and a narrower population than the advertised market. Product governance, supplier review, and ordinary disclosures are otherwise complete. What control is most directly missing under consumer-protection principles?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Replace the numerical claim with a general innovation statement.Changing wording may avoid one claim, but it does not establish evidence for any remaining capability representations.
- Substantiate accuracy across the advertised population and use conditions. ✓Evidence must support the specific accuracy claim’s population, scope, and conditions rather than extrapolating from a narrower internal test.
- Ask the vendor to confirm the advertised accuracy.Vendor confirmation alone is not evidence that the claim is substantiated across the population and market described.
- Add a prominent disclaimer about possible errors.A disclaimer may inform users, but it does not substantiate a numerical accuracy claim exceeding the tested population and scope.
The trap
Compare the claim’s exact scope with the evidence’s scope before relying on a disclaimer or supplier statement. How to remember it
The accuracy claim exceeds the tested scope; substantiation must match the advertised population and conditions.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How Laws, Standards and Frameworks Apply to AI questions
- Verify rights or permissions for the training materials: What control addresses the remaining issue? →
- Align the claim with substantiated scope: What control is most directly missing? →
- Verify evidence substantiates the company's specific claim: What control addresses the remaining →
- All 394 Understanding How Laws, Standards and Frameworks Apply to AI questions →
Part of the Certsqill AIGP question bank · Understanding How Laws, Standards and Frameworks Apply to AI ·
Every answer, right and wrong, comes with its own explanation.