Business Analyst - AI Response Evaluator (Contract, Turing Remote)
Conducted side-by-side (SxS) evaluations of GHD model outputs by comparing multiple completions and selecting the strongest response using rubric criteria. Scored instruction adherence, completeness, relevance, and factual accuracy, documenting misses, gaps, and strengths for each comparison. Verified claims using targeted web research to separate supported information from assumptions. • Performed rubric-based SxS response selection • Rated instruction-following, completeness, relevance, and factuality • Performed web-backed claim verification • Wrote concise rationales explaining evaluation decisions