Freelance AI Data Specialist / Annotation Contributor (Remote) — 2025 to Present
Freelance AI data specialist performing review and evaluation of AI-generated outputs using structured guidelines and evaluation frameworks. Responsibilities include annotation, classification, and content review focused on accuracy, relevance, consistency, and instruction compliance, along with documenting decisions using clear reasoning. The work also includes pairwise comparison evaluations to assess response quality and model performance, while flagging ambiguous, inconsistent, or low-quality outputs with detailed feedback for quality improvement. • Review AI outputs for accuracy, relevance, consistency, and instruction compliance • Perform annotation, classification, and content review per structured guidelines • Document annotation decisions with supporting explanations • Run pairwise comparisons to determine response quality and model performance