Senior Data Annotation Specialist & AI Trainer (Outlier AI / Scale AI (Remotasks))
Performed named entity recognition (NER) tagging, intent classification, sentiment labeling, and text span annotation for NLP and multimodal AI datasets. Applied rubric-based evaluation to rate AI-generated outputs for instruction-following, factual accuracy, coherence, and safety compliance to support RLHF training batches. Maintained high accuracy through blind quality-check audits and peer review. • Labeled conversational and legal/medical text corpora • Escalated 800+ edge cases and ambiguous instances to improve guidelines • Audited 1,200+ weekly submissions as a peer-review auditor • Achieved 98.6% accuracy and 96.8% inter-rater agreement on relevant tasks