Data drift, where the statistical properties of live: Which underlying cause best explains this pattern?
Gradual post-launch accuracy loss from changing input distributions is data drift.
The question
Months after launch, a deployed demand-forecasting model steadily loses accuracy even though its code is unchanged; investigation shows that the distribution of incoming data no longer matches the training data. Which underlying cause best explains this pattern?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Data drift, where the statistical properties of live inputs diverge from those seen during training. ✓Gradual accuracy loss from shifting input distributions is classic data drift.
- Brittleness, where small perturbations to individual inputs cause sudden and disproportionate failures.Almost right as a failure mode, but brittleness is abrupt sensitivity to perturbations, not gradual distribution shift.
- Insufficient testing, where failure modes existed at launch because pre-release evaluation was too narrow.Almost right as a cause category, but the model performed well initially and degraded later, pointing to drift.
- Lack of quality data, where the original training set was too noisy or incomplete to learn the task well.Plausible, but poor initial data would show at launch, whereas here performance decayed after a good start.
The trap
Attributing gradual post-launch decay to launch-time causes (poor data, weak testing) instead of drift. How to remember it
Gradual post-launch accuracy loss from changing input distributions is data drift.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Contain the impact: Which response best reflects that procedure? →
- Instructions for use that describe the system's: Which artifact is most directly aimed at giving deployers the →
- Specifying the concrete problem: Which step most directly reflects defining the business context and use case →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.