Legal & Compliance AI Rater (Freelance / Remote)
Delivered legal & compliance-oriented AI output evaluations using structured rubrics and detailed quality guidelines. Assessed outputs for factual accuracy, relevance, legal reasoning consistency, completeness, and policy alignment. Identified hallucinations, ambiguity, misleading guidance, and unsafe or non-compliant recommendations while maintaining consistent scoring standards. • Evaluated and ranked/classified AI responses using judgment-based criteria • Conducted hallucination detection and ambiguity detection for legal/compliance contexts • Documented evaluation reasoning clearly for auditability and reviewer alignment • Contributed qualitative feedback to improve model trustworthiness, safety, and reliability