A record of datasets: Which artifact most directly satisfies this need?
Documenting datasets, splits, hyperparameters, and metrics is exactly what lets an auditor validate and reproduce training and testing results.
The question
An internal auditor asks the development team to prove that a released classifier's reported evaluation metrics can be reproduced and that the test data was independent of training data. The team is asked which documentation the training-and-testing phase should have produced. Which artifact most directly satisfies this need?
Preparing for AIGP? Take the free 5-min readiness quiz →
- A signed acceptable-use policy defining who may operate the system and what prohibited uses apply once it is in production.Plausible but wrong: an acceptable-use policy governs deployment behavior, not the reproducibility of training and testing results.
- A vendor licensing summary listing the model's usage rights, indemnities, and the supplier's stated performance benchmarks.Almost right because it references benchmarks, but licensing records describe an acquired product rather than the team's own test procedure.
- A stakeholder communications plan describing how evaluation outcomes will be disclosed to affected users and regulators.Plausible but wrong: a communications plan supports transparency disclosures, not the reproduction and validation of the metrics themselves.
- A record of datasets, splits, hyperparameters, and evaluation metrics captured to validate results and support compliance. ✓Correct because III.B.5 documents the training/testing process specifically to validate results, establish compliance, and manage risks.
The trap
Assuming any governance document proves reproducibility, when only the training/testing process record captures splits and metrics. How to remember it
Documenting datasets, splits, hyperparameters, and metrics is exactly what lets an auditor validate and reproduce training and testing results.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Development questions
- Document the proxy-bias and overfitting findings: Which action best fits a training-and-testing →
- A model card summarizing intended use: Which readiness artifact directly addresses the standardized summary →
- Track performance against thresholds continuously: Which response best reflects that maintenance obligation? →
- All 426 Understanding How to Govern AI Development questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Development ·
Every answer, right and wrong, comes with its own explanation.