Data Annotation Expert (Outlier AI)
Evaluated and annotated LLM outputs across reasoning, factuality, safety, and other quality dimensions using strict rubric-based scoring systems. Maintained high accuracy with low rejection rates while handling complex edge cases, including ambiguous prompts and adversarial inputs. Contributed feedback loops to improve annotation guidelines and training dataset quality. • Evaluated and annotated LLM responses (reasoning, factuality, safety) • Applied rubric-based scoring for model training data quality • Handled edge cases including ambiguous and adversarial prompts • Provided feedback to refine annotation guidelines