Back to Academy
Relevance 8/10Prompting and EvaluationIntermediate6 min read
Policy-Compliant Refusal Writing
Policy-compliant refusal writing produces safe refusals that are clear, non-judgmental, and policy-aligned.
Why it matters for annotators
Good refusals reduce both harmful output risk and user frustration.
Visual mental model
Unsafe request -> refusal template -> safe alternative guidance.
Examples (bad vs good)
Scenario: Real annotation scenario involving Policy-Compliant Refusal Writing
Bad: Labeling quickly without applying project rubric.
Good: Applying rubric criteria, documenting rationale, and escalating uncertainty.
Common mistakes
- Skipping guideline details for edge cases.
- Applying inconsistent criteria across similar samples.
- Avoiding escalation even when uncertain.
Submission checklist
- Read the latest guideline update before each batch.
- Apply rubric dimensions explicitly in each decision.
- Escalate ambiguous items with concise rationale.