AI Data Annotator & Quality Reviewer (AI Data Annotator and Evaluator) — Scale AI (Remote Contract)
Performed large-scale text annotation and quality review to support training and fine-tuning of large language models and related AI systems. Participated in RLHF evaluation cycles by rating and ranking AI-generated responses to improve alignment and safety. Maintained dataset accuracy above 97% by identifying mislabels and interpreting complex guideline taxonomies across diverse domains. • Annotated and labeled over 50,000 text samples for model development • Conducted quality assurance checks to catch mislabelled entries • Applied annotation guidelines consistently for medical, legal, and conversational text • Collaborated remotely with global teams using Slack, Jira, and internal dashboards