Skip to content
OpenTrain AIFor AI Companies

AI Training Data Quality Manager

Lead quality strategy for large-scale AI training data and chatbot evaluation programs. Build quality systems, guide QA teams, and improve delivery across a 16-week project.

Apply now
OpenTrain AI

Generative AI & RLHF

100% Remote

Contract, part-time

Engagement

Remote

Location

Oct 13, 2026

Posted

Open worldwide

The Work

You will lead quality strategy for AI training data and annotation programs. The work focuses on evaluation tasks where multiple chatbots are compared and given a final assessment.

You will oversee quality systems, support consistent delivery, and work with project leaders to balance quality, speed, and cost.

  • Define quality standards, metrics, and targets across data types.
  • Build and lead Quality Leads and QA teams.
  • Design audit, sampling, calibration, and escalation frameworks.
  • Lead quality reviews and manage quality-related escalations.
  • Identify root causes and improve processes, training, and guidelines.
  • Monitor quality reports and drive corrective actions.

What It Pays and Takes

This is a project-based contractor role involving a defined number of evaluation tasks. The engagement is planned for 16 weeks.

  • Schedule: 20 or more hours per week.
  • Working pattern: five working days per week, including weekends as required, with two weekdays off.
  • Work hours: 7:00 a.m. to 4:00 p.m. Pacific Time.
  • Location: Open worldwide.
  • Language: Professional fluency in English.
  • Experience: At least 8 years of professional experience, including 4 or more years leading teams.
  • Strong quality management and high-volume operations experience.
  • Experience designing and scaling quality systems.
  • Experience leading managers or team leads.
  • Excellent analytical, communication, and stakeholder-management skills.
  • Preferred experience with annotation, data labeling, AI training data, multimodal work, or large language model evaluation.

How It Works

OpenTrain is a platform where people find AI training and data-labeling roles, build a profile, and start applications. Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that learn from examples, including comparing chatbot answers and rating model outputs. People with experience in quality management and specialized evaluation work help make these systems more accurate and consistent.

Requirements

  • Experience: Entry level
  • Languages: English

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

Ready to apply?

Create a free OpenTrain account and apply for this role in minutes.

Keep exploring

Similar open roles

View all AI training jobs

AI Training Supply Coordinator

Coordinate contributors, workforce data, onboarding, and project capacity across AI training work. This remote, 16-week freelance role also includes comparing chatbot responses and making final assessments.

Generative AI & RLHF
Text
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Oct 13, 2026

Senior AI Annotation Quality Lead

Guide quality decisions for AI annotation and chatbot evaluation projects. You will lead calibration, resolve difficult cases, review audits, and improve guidelines in a remote, project-based role.

Generative AI & RLHF
Text
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Oct 13, 2026

Chatbot Response Quality Analyst

Review AI-generated chatbot responses, apply detailed rubrics, and write clear feedback that helps improve AI systems. This remote, 16-week contractor project requires fluent English and runs five days per week.

Generative AI & RLHF
Text
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Oct 13, 2026

Quality Analyst for Chatbot Response Evaluation

Review AI chatbot responses against project rubrics, explain your judgments, and help improve model behavior. Work 20+ hours per week across five working days, with weekends as needed and two weekdays off.

Generative AI & RLHF
Text
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Oct 13, 2026

Python Domain Expert for LLM Evaluation

Assess Python-focused large language model responses for accuracy, reasoning, and quality, then give clear feedback that supports model improvement. This worldwide contract role requires 20+ hours per week, fluent English, a relevant master's degree, and three years of experience.

Generative AI & RLHF
Text
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Oct 13, 2026