AI Data Evaluation QC Engineer

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this opportunity. OpenTrain helps people build careers in AI training and data labeling by connecting their skills, project experience, and professional profile to cutting-edge work.

• Remote contractor opportunity
• Three-month assignment
• Part-time schedule of at least 20 hours per week

About AI Data Evaluation Work

AI data evaluation is the quality-focused work behind reliable artificial intelligence. Human experts review tasks, model outputs, scoring criteria, and verification methods to determine whether AI systems and the data used to assess them meet the intended standard.

• Contribute to the human quality controls behind AI development
• Use technical judgment to evaluate correctness and consistency
• Help improve how AI evaluation projects measure performance

The Role

OpenTrain is seeking an AI Data Evaluation QC Engineer to assess the quality and technical correctness of AI data evaluation projects. You will review tasks, outputs, evaluation criteria, verifiers, rubrics, and test cases while making independent quality and delivery judgments.

This opportunity is designed for a practicing software engineer who can work independently across quality control and technical delivery responsibilities. Experience with AI data, model evaluation, task generation, or similar projects is valuable.

• Subject matter: AI data evaluation quality control
• Employment type: Contractor and part-time
• Experience level listed for the role: Entry level

What You’ll Do

You will help establish whether project work meets a demanding quality standard. The role requires independent validation rather than relying only on automated quality-control results, along with consistent ownership in demanding project environments.

• Review AI data evaluation tasks and outputs for technical correctness and overall quality
• Assess whether evaluation criteria and rubrics measure the intended standard
• Review verifiers and test cases for effectiveness
• Independently validate work beyond automated QC results
• Support quality-control pipelines
• Make informed final quality and delivery decisions
• Deliver reliably and consistently across project responsibilities

Required Skills and Background

You should be a practicing software engineer with strong technical fundamentals and sound technical judgment. You should understand quality-control pipelines, know what makes a task or verifier effective, and be able to assess technical correctness independently.

The role also calls for experience as a QC expert, technical project lead, delivery lead, or equivalent technical owner. Relevant experience may include designing, implementing, or reviewing quality frameworks at scale and owning final decisions for a technical project.

• Strong software engineering fundamentals
• Hands-on experience with QC pipelines and technical correctness assessment
• Experience designing or reviewing verifiers, rubrics, test cases, or task-quality frameworks
• Experience owning final quality or delivery decisions in a technical project
• Strong ownership, reliability, and delivery judgment
• AI data, model evaluation, or task-generation experience is valuable

Schedule and Location

This is a fully remote, three-month contractor assignment. You must be available for at least 20 hours per week, including at least four hours per day and four hours of overlap with Pacific Time.

• Minimum commitment: 20+ hours per week
• Daily availability: at least 4 hours per day
• Required overlap: 4 hours with Pacific Time
• Eligible locations: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, and Mexico
• Working language: English

Build Your AI Training Career with OpenTrain

AI training and data labeling are expanding fields where people help shape how modern AI systems perform. OpenTrain gives contributors a place to build a credible record of this work, discover relevant opportunities, and develop a longer-term professional portfolio.

• Create an OpenTrain account for free
• Showcase relevant technical and AI evaluation experience
• Apply to opportunities that match your skills
• Build a portfolio around AI training and data quality work