Error and stockout rates stratified by store size: Which evidence is most useful?
Stratified outcome evidence can reveal group-level harms hidden by pooled forecasting performance.
The question
A retailer’s demand-planning model performs well overall, but small stores report recurring stockouts while large stores receive excess inventory. Leadership wants evidence before approval that addresses individual and group effects. Which evidence is most useful?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Error and stockout rates stratified by store size and region. ✓Stratified operational outcomes reveal whether harms concentrate across groups while preserving the business context of shortages and excess inventory.
- A feature-importance chart for the forecasting model.Feature importance may describe model behavior, but it does not establish unequal operational outcomes among stores.
- Interviews with planners who approve replenishment recommendations.Planner perspectives may identify workflow concerns, but interviews alone cannot quantify concentrated stockouts or excess allocation.
- One combined forecast error across all stores.A pooled metric can conceal systematic differences between store groups and cannot identify whether particular locations experience recurring harm.
The trap
If harm may cluster, disaggregate outcomes by the affected operational groups. How to remember it
Stratified outcome evidence can reveal group-level harms hidden by pooled forecasting performance.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding the Foundations of AI Governance questions
- Testing counselor intervention rates and error detection: Before approval, which evidence best resolves the →
- Repeated evaluation across varied: Before approval for varied productions, which evidence most directly →
- Publish system outcomes and retain case-level decision: Which evidence plan best matches those distinct needs? →
- All 337 Understanding the Foundations of AI Governance questions →
Part of the Certsqill AIGP question bank · Understanding the Foundations of AI Governance ·
Every answer, right and wrong, comes with its own explanation.