AI Data Annotation Specialist at Outlier AI (Remote)
Text
RLHFAnnotated and validated large-scale text datasets for training and evaluating AI/LLMs, ensuring outputs followed established guidelines. Performed quality assurance on AI-generated responses and evaluated prompts and responses for factual correctness, relevance, coherence, tone, and policy compliance. Applied taxonomy labeling, ranking, scoring, and classification guidelines to support reinforcement learning from human feedback workflows. • Compared model outputs to identify higher-quality responses • Conducted dataset validation and consistency checks • Flagged inconsistencies and edge cases and recommended improvements • Ensured productivity and SLA performance targets while maintaining annotation accuracy
2025 - Present