The responsible AI checklist for every feature
A 10-item checklist you run on every feature before launch. This is what senior AI engineers do, every time.
A pilot's pre-flight checklist. Boring. Critical.
The checklist:
- Use case is appropriate for LLMs.
- System prompt is hardened and reviewed.
- Refusal path exists for unknown answers.
- Citations or proof included for factual claims.
- Input filter for known attacks.
- Output validation against schema or rules.
- Logs are structured and PII-safe.
- Cost cap set at provider and per-user.
- Bias and quality eval run with a documented passing bar.
- User disclosure that AI is being used.
If any item is "no", do not ship.
A YAML checklist you keep in /docs/safety/<feature>.yaml:
feature: pdf_chatbot
appropriate_use: yes
system_prompt_review: yes
refusal_path: yes
citations: yes
input_filter: yes
output_validation: partial
logging: yes
cost_cap: yes
eval_passed: yes (score 0.86)
user_disclosure: yes
launch_blockers: ["output validation: schema for citations format"]
Version-controlled. Reviewed in PRs.
Quick recall
3 prompts · think before you flip
Prompt 1 of 3
Name 5 checklist items.
Quiz time
1 question · tap an answer to check it
1. A red flag that the safety checklist is being skipped
Finished lesson 11.5?
Mark complete to update your module progress and unlock the streak.
Loading