Track live performance and input distributions: Which practice best fulfills this objective?
Continuous monitoring means tracking performance and input distributions on a schedule and triggering maintenance or retraining when metrics degrade past thresholds.
The question
A fraud-detection model operates in an environment where attacker behavior evolves constantly. Governance requires continuous monitoring and a regular maintenance cadence after release. Which practice best fulfills this objective?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Freeze the model after validation and preserve its exact configuration indefinitely so that its behavior stays perfectly consistent for every future prediction.Plausible because stability sounds desirable, but freezing a model in an evolving threat environment guarantees drift and defeats the purpose of continuous monitoring.
- Track live performance and input distributions on a schedule, and trigger maintenance, updates or retraining when monitored metrics degrade past defined thresholds. ✓Correct because continuous monitoring plus a maintenance/retraining cadence tied to threshold breaches is precisely how a model is kept effective as its environment shifts.
- Rely on end users to report suspected errors through a support form, and schedule a full model rebuild only once accumulated complaints exceed an agreed monthly volume threshold.Plausible because user feedback is a useful signal, but complaint-driven rebuilds are reactive and lack the scheduled metric monitoring the objective requires.
- Rotate the encryption keys protecting the model artifact each quarter so that any compromised credential grants access for only a limited period.Plausible because key rotation is good security hygiene, but it addresses credential risk rather than monitoring performance and scheduling retraining.
The trap
Treating a validated model as 'done' or relying on user complaints, when a changing environment demands scheduled monitoring and threshold-triggered retraining. How to remember it
Continuous monitoring means tracking performance and input distributions on a schedule and triggering maintenance or retraining when metrics degrade past thresholds.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- A model card summarizing the model's intended use: Which artifact should they produce? →
- Red teaming, where testers adversarially probe the model: Which activity is being described? →
- A description of the incident: Which set of contents best fulfills the objective of managing and documenting →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.
