Content & Data Analyst (Independent Contractor) — AI Response Evaluation & Feedback
Evaluated and rated AI-generated text outputs using multi-criteria rubrics for factuality, fluency, relevance, and safety. Produced structured, written feedback reports that documented failure modes and strengths to support iterative model improvements. Maintained 98%+ inter-rater agreement through guideline adherence and self-calibration reviews.• Reviewed large volumes of text for quality assessment and dataset validation signals.• Applied rigorous multi-criteria evaluation standards to ensure compliance with safety and relevance requirements.• Generated rubric-aligned critiques that were specific and actionable for model refinement.• Participated in independent, async remote workflows to meet throughput and quality targets.