Treat reliability as unestablished because performance | AIGP
7-day money-back guarantee — full refund within 7 days of purchase if you've completed under 20% of the questions. See pricing →
Certifications Tools Flashcards Career Paths Exam Guides Blog Pricing For Teams About

Language

✓ EnglishDeutschEspañolFrançaisPortuguês
Check readiness — free →

Treat reliability as unestablished because performance: Which conclusion is most defensible?

AIGP Understanding the Foundations of AI Governance Medium

Reliability remains unestablished because performance varies across relevant cohorts.

The question

An education administrator tests a placement model on one unusually small class and obtains 98% correct predictions. The model’s error rate varies substantially across earlier cohorts. Which conclusion is most defensible?

Preparing for AIGP? Take the free 5-min readiness quiz →

  1. Classify the model as fair from this score.
    A single accuracy score on a small class does not establish fairness or show how errors are distributed among student groups.
  2. Report the class accuracy as measured.
    Reporting the measured result is appropriate, but it does not support a conclusion about general reliability.
  3. Reject the model as unreliable because all probabilistic predictions contain uncertainty.
    Probabilistic uncertainty is compatible with reliable performance; the evidence problem here is variation across conditions, not uncertainty itself.
  4. Treat reliability as unestablished because performance varies across relevant cohorts. ✓
    Reliability requires dependable performance across relevant conditions. A small atypical sample and substantial cohort variation do not establish it.
The trap
A strong one-time score is evidence of accuracy there, not necessarily reliable performance generally.

How to remember it

Reliability remains unestablished because performance varies across relevant cohorts.

How many of these would you get right?

One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.

Test your AIGP readiness — free

More Understanding the Foundations of AI Governance questions

Part of the Certsqill AIGP question bank · Understanding the Foundations of AI Governance · Every answer, right and wrong, comes with its own explanation.