Part-time/Freelancer AI Data Annotator (LLM output evaluation and text annotation)
Performed LLM output evaluation and data annotation using structured guidelines to ensure high-quality decisions. Wrote concise rationales supporting label choices while maintaining consistency across labeling tasks by applying rule-based judgment. Conducted quality checks and revisions to reduce ambiguity and align outputs with project requirements. • Evaluated model outputs against guideline criteria • Annotated dialogue-style and multi-turn interactions for coherence and tone • Flagged narrative inconsistencies and suggested corrective edits • Tracked edge cases to keep labeling consistent across samples