Treat the missingness as systematic: Which conclusion | AIGP
7-day money-back guarantee — full refund within 7 days of purchase if you've completed under 20% of the questions. See pricing →
Certifications Tools Flashcards Career Paths Exam Guides Blog Pricing For Teams About

Language

✓ EnglishDeutschEspañolFrançaisPortuguês
Check readiness — free →

Treat the missingness as systematic: Which conclusion is decisive?

AIGP Understanding How to Govern AI Development Hard

Concentrated missing labels can make aggregate accuracy unrepresentative of small-business documents.

The question

A financial-document classifier is evaluated on a random held-out sample and reports strong accuracy. Thirty percent of documents lack labels, and the missing labels are concentrated among small-business applicants whose forms differ from the rest. Which conclusion is decisive?

Preparing for AIGP? Take the free 5-min readiness quiz →

  1. Increase the random test sample without repairing the label gap.
    A larger random sample can retain the same systematic missingness and does not establish correct outcomes for affected documents.
  2. Treat the missingness as systematic. ✓
    Concentrated missing labels indicate structured missingness, so aggregate accuracy may not represent small-business documents.
  3. Assume unlabeled documents resemble the labeled population.
    The stated concentration among small-business applicants contradicts an assumption that unlabeled documents are representative.
  4. Use synthetic labels as ground truth for the affected documents.
    Synthetic labels may reproduce bias or errors and do not independently validate outcomes for the affected applicants.
The trap
Ask whether missing labels are random across the intended population before trusting an aggregate metric.

How to remember it

Concentrated missing labels can make aggregate accuracy unrepresentative of small-business documents.

How many of these would you get right?

One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.

Test your AIGP readiness — free

More Understanding How to Govern AI Development questions

Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development · Every answer, right and wrong, comes with its own explanation.