AI Data Specialist (Generalist Focus) at Defined.ai
Performed human-in-the-loop evaluation of AI-generated outputs for accuracy, relevance, tone, and instruction compliance. Applied detailed guidelines to check language understanding, intent classification, and overall response quality while ensuring fairness. Identified bias and ethical risks, then provided structured feedback and participated in quality calibration to improve model behavior. • Evaluate AI outputs for accuracy, relevance, tone, and compliance • Assess language understanding and intent classification • Review and correct annotated datasets for consistency and fairness • Flag bias/ambiguity/ethical risks and give structured feedback