Data Quality AI Evaluation Analyst

You will review datasets and task outputs used to train AI systems. Your work will focus on accuracy, completeness, consistency, and adherence to written instructions.

You will make structured decisions across high-volume review assignments, explain the reasoning behind difficult calls, and flag patterns that may point to broader data issues.

• Review datasets and task outputs against quality standards.
• Find errors, inconsistencies, and results that do not follow the instructions.
• Apply rubrics consistently across large sets of data.
• Document decisions when guidelines are incomplete or unclear.
• Escalate recurring problems for further analysis.
• Give clear written and verbal feedback with practical resolution paths.

What it pays and takes

This is a part-time contractor role for an analytical person who can make careful decisions and communicate clear feedback. Prior AI experience is not required, but strong data review and evaluation skills are important.

• Pay: $30 to $60 per hour.
• Time: Fewer than 20 hours per week.
• Location: Open to candidates in the United States.
• Language: Fluency in English required.
• Work level: Listed as entry level.
• Required skills: Data review, quality assurance, analytical judgment, and attention to detail.
• Required tools: Spreadsheet fluency, including sorting, filtering, and simple formulas.
• Helpful experience: SQL, data querying, data annotation, labeling, or rubric-based evaluation.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About OpenTrain and AI training work

OpenTrain is a platform where people find AI training and data-labeling work, build a profile, and apply to projects. AI training work is the human review behind modern AI systems, including checking data and evaluating model-related outputs so systems can learn from reliable examples.