Back to Academy
Relevance 7/10Text and NLPIntermediate6 min read
Translation Quality Estimation
Translation quality estimation scores adequacy and fluency of translated outputs.
Why it matters for annotators
It helps validate multilingual model outputs and human translations.
Visual mental model
Source -> translation -> adequacy/fluency score.
Examples (bad vs good)
Scenario: Real annotation scenario involving Translation Quality Estimation
Bad: Labeling quickly without applying project rubric.
Good: Applying rubric criteria, documenting rationale, and escalating uncertainty.
Common mistakes
- Skipping guideline details for edge cases.
- Applying inconsistent criteria across similar samples.
- Avoiding escalation even when uncertain.
Submission checklist
- Read the latest guideline update before each batch.
- Apply rubric dimensions explicitly in each decision.
- Escalate ambiguous items with concise rationale.