AI Data Specialist (Generalist Focus) at Defined.ai
Evaluated AI-generated outputs for accuracy, relevance, tone, and compliance with instructions using provided guidelines. Reviewed annotated datasets to ensure consistency and fairness across examples. Flagged bias, ambiguity, and ethical risks, then provided structured feedback to improve system behavior. • Assessed language understanding and intent classification • Checked response quality against detailed criteria • Participated in quality calibration exercises with distributed teams • Ensured annotation consistency across dataset revisions