Jermaine E.

Key Skills

Software

Other

Top Subject Matter

Generative AI/LLM response evaluation (general knowledge and applied GenAI)

Generative AI/LLM evaluation and quality/risk assessment

AI systems content quality review for training/evaluation pipelines

Top Data Types

Text

Document

Top Task Types

No task types listed

Freelancer Overview

Freelance Generalist AI Reviewer (Independent Contractor). Brings 6+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Other. Education includes Bachelor of Science, Prairie View A&M University. AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

Freelance Generalist AI Reviewer (Independent Contractor)

OtherText

Reviewed and evaluated AI-generated responses for truthfulness, factual accuracy, completeness, relevance, and depth of insight using detailed project rubrics. Applied structured evaluation guidelines to ensure consistent, objective, and repeatable assessments across thousands of tasks. Flagged hallucinations, misleading claims, logical inconsistencies, missing context, and low-quality responses that could reduce user trust and support model alignment improvements.•Assessed response quality across multiple dimensions per rubric requirements.•Identified recurring weakness patterns, gaps in reasoning, and inaccuracy trends.•Maintained high throughput in an asynchronous, task-based workflow.•Documented issues to enhance long-term model quality and trustworthiness.

2022 - Present

AI Quality Analyst - Generative AI (Contract)

OtherText

Conducted detailed reviews of LLM-generated content to verify compliance with accuracy, completeness, and instruction-following standards. Performed comparative evaluations of multiple AI responses to determine optimal output quality and ranking. Flagged risks such as fabricated information, unsupported assertions, and ambiguous or misleading outputs while maintaining high objectivity under strict guidelines.•Reviewed outputs for factual correctness, clarity of reasoning, contextual appropriateness, and user usefulness.•Ranked and selected best responses via side-by-side comparisons.•Documented systematic errors and performance gaps to inform model quality improvements.•Ensured consistent adherence to evaluation documentation and requirements.

2022 - 2023

Technical Reviewer & Content Quality Specialist (AI Systems) (Contract)

OtherText

Reviewed AI-assisted technical and general content for accuracy, coherence, and completeness prior to downstream use in AI training and evaluation pipelines. Used structured feedback and scoring systems to provide quality assessments to research and product teams. Focused on attention to detail for edge cases and ambiguous evaluation scenarios within defined quality standards.•Validated content against defined quality standards before pipeline ingestion.•Provided structured feedback and scores through an evaluation workflow.•Checked for coherence and completeness to reduce downstream errors.•Evaluated ambiguous cases to support more reliable model training/evaluation.

2021 - 2022

Education

Work History