AI Data Specialist (Generalist Focus) — Defined.ai (Kansas, US)
Evaluated AI-generated outputs for accuracy, relevance, tone, and adherence to provided instructions and guidelines. Reviewed and corrected annotated datasets to improve consistency, fairness, and quality for downstream use. Identified and flagged bias, ambiguity, and ethical risks, then provided structured feedback to support model quality improvements. • Assessed language understanding and intent classification • Performed quality calibration with distributed teams • Reviewed annotated dataset consistency and fairness • Provided guideline-based feedback to improve AI behavior