Defined.ai — AI Data Specialist (Generalist Focus) (Kansas, US)
Evaluated AI-generated outputs for accuracy, relevance, tone, and adherence to instructions using provided guidelines. Reviewed and corrected annotated datasets to improve consistency and fairness, and assessed language understanding and intent classification to validate response quality. Flagged bias, ambiguity, and ethical risks, then provided structured feedback to help improve AI system behavior and participated in quality calibration with distributed teams. • Accuracy, relevance, tone, and instruction compliance checks • Language understanding, intent classification, and response quality evaluation • Annotated dataset review/correction for consistency and fairness • Bias and ethical risk identification with feedback