Senior Data Annotation Specialist (Lead annotator) — Appen (Remote)
Served as lead annotator for conversational AI projects, reviewing and rating model outputs for English and Yoruba content. Maintained inter-annotator agreement (IAA) above 94% through consistent evaluation practices. Refined annotation guidance for edge cases to improve labeling consistency and team efficiency. • Reviewed and rated model outputs for conversational AI • Ensured IAA scores stayed above 94% • Delivered 85,000+ labeled data points • Mentored 8 junior annotators and ran weekly calibration sessions