Test retrieval of current hours from the authoritative: What evidence is needed for the hours requirement?
Fine-tuning can shape script behavior, but current clinic hours require testing retrieval from an authoritative schedule.
The question
A medical administration office, without clinical advice, wants an assistant to follow a new appointment-escalation script. The team fine-tunes the model on examples but also expects it to know current clinic hours. What evidence is needed for the hours requirement?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Evaluate whether fine-tuning improves script adherence.Fine-tuning evidence addresses behavior and script following, not whether the system knows current external clinic hours.
- Compare model size using a general factuality benchmark.General factuality scores do not establish access to the clinic’s current hours or reliable use of authoritative sources.
- Review additional training examples for appointment scenarios.More examples may improve script behavior but cannot ensure current hours are available or accurately represented.
- Test retrieval of current hours from the authoritative clinic schedule. ✓Current hours are external, changing facts; retrieval testing determines whether the assistant accesses and uses the authoritative schedule.
The trap
If the requirement concerns changing information, look for evidence of authoritative retrieval rather than more training examples. How to remember it
Fine-tuning can shape script behavior, but current clinic hours require testing retrieval from an authoritative schedule.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Deployment and Use questions
- Test retrieval freshness and answer faithfulness after: What evidence is decisive before approval? →
- Test role- and plant-specific retrieval: What evidence should precede approval? →
- Sandboxed adversarial traces with approval logs: Before approval, which evidence most directly resolves that →
- All 424 Understanding How to Govern AI Deployment and Use questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Deployment and Use ·
Every answer, right and wrong, comes with its own explanation.