AI Data Specialist (Generalist Focus) — Defined.ai
Served as an AI Data Specialist performing human-in-the-loop evaluations of AI-generated text outputs. Assessed responses for accuracy, relevance, tone, and compliance with detailed instructions and guidelines. Reviewed annotated datasets to improve consistency, fairness, and ethical safety. • Evaluated language understanding and intent classification quality • Checked instruction following and response quality against rubrics • Flagged bias, ambiguity, and ethical risks for remediation • Provided structured feedback to improve AI behavior and QA outcomes