Forecast the foreseeable misuse and add usage restrictions: Which governance action best addresses this
Foreseeable misuse of a benign feature is governed by forecasting it and adding safeguards to reduce downstream harm.
The question
A translation feature in a deployed app can be prompted to produce convincing phishing messages in many languages, a use the team did not intend but can foresee. Which governance action best addresses this concern?
Preparing for AIGP? Take the free 5-min readiness quiz →
- Keep refining the model's translation fluency so its multilingual output reads even more naturally to readersHigher fluency does nothing to prevent misuse and could actually make abusive outputs more convincing.
- Migrate the entire feature to a cheaper compute region to lower its per-request operating costReducing operating cost is a budget matter and ignores the foreseeable harmful use entirely.
- Forecast the foreseeable misuse and add usage restrictions and safeguards to reduce the downstream harm ✓Anticipating the phishing misuse and constraining it directly reduces the foreseeable downstream harm, as the objective requires.
- Revise the product marketing copy to highlight the wide breadth of languages the feature supportsMarketing messaging does not forecast or mitigate the misuse risk the scenario raises.
The trap
Improving the feature's intended performance while leaving a foreseeable misuse pathway unaddressed. How to remember it
Foreseeable misuse of a benign feature is governed by forecasting it and adding safeguards to reduce downstream harm.
How many of these would you get right?
One of 1581 AIGP questions on Certsqill. Take a free five-minute check and see your score per domain — not one number, but which section to open tonight.
Test your AIGP readiness — freeMore Understanding How to Govern AI Deployment and Use questions
- Incidents, issues and risks, together with the system's: As part of governing a deployed AI system, which set →
- An external communication plan assigning ownership: Which governance element does this describe? →
- A policy and control to deactivate the AI system so it can: Which pre-established control most directly →
- All 424 Understanding How to Govern AI Deployment and Use questions →
Part of the Certsqill AIGP question bank · Understanding How to Govern AI Deployment and Use ·
Every answer, right and wrong, comes with its own explanation.