Skip to content
OpenTrain AIFor AI Companies

Domain Contributor, Evaluation Specialist

Apply now

Job details

Pay

$30–$60 USD/hr

estimate, paid per accepted task

Engagement

Contract, part-time

Location

Remote

52 countries

Posted

Oct 21, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting a Domain Contributor - Evaluation Specialist to create demanding questions and scenarios, assess generated responses, and provide source-grounded feedback that helps improve advanced AI systems. This contractor role supports expert work across history, archival and library science, law, finance, journalism, technology, and related areas.

What you will do
You will design nuanced, domain-specific tasks that probe model limits and reveal reasoning flaws. You will write questions and scenarios requiring deep subject-matter knowledge, validate AI-generated outputs against authoritative primary sources, and explain missed reasoning, factual errors, source problems, and important nuances. You will apply detailed task guidelines and evaluation rubrics consistently and produce clear written and verbal deliverables.

Required skills
You should have hands-on experience with AI model training, annotation, RLHF, or model evaluation, along with deep expertise in history, archival or library science, law, finance, journalism, technology, or a related area. Advanced research ability, experience verifying complex claims against authoritative sources, exceptional written and verbal communication, and careful adherence to detailed instructions are required.

Helpful background
Experience designing adversarial tasks, graduate-level research experience, experience at a Fortune 100 company, or professional fluency in a non-English language is helpful.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

Requirements

  • How pay works: You are paid for each task you submit that the project accepts. The hiring company estimates this comes to $30–$60 an hour. What you earn depends on how many tasks you finish and how many are accepted.
  • Experience: Intermediate level
  • Languages: English
  • Skills: Domain depth, Source verification, Reasoning clarity, Evaluation expertise

Open to applicants in

  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmvhz59xt002u08l2zx6lyjzh

Keep exploring

Similar open roles

View all AI training jobs

Independent Professional Domain Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

domain-expertiseclient-relationship-managementwritten-communicationanalytical-thinkingai-content-evaluation
Text
Remote · Canada, United States
English
Part-time · Flexible
Mid-Senior level
Hourly · $40–$120/hr

Posted Nov 11, 2026

Independent Consultant, Finance, Data & Engineering (Domain Expert)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

finance and accounting expertisedata analysissoftware engineeringtechnical documentationspreadsheets (e.g., excel)business intelligence (bi) platforms
Documents
Remote · Canada, United States
English
Part-time · Flexible
Mid-Senior level
Hourly · $60–$120/hr

Posted Nov 11, 2026

Multidisciplinary Undergraduate AI Evaluation Contributor

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $100/hr

Posted Nov 10, 2026

Creative Technology AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $135/hr

Posted Nov 5, 2026

Finance & Accounting AI Evaluation SME

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

AccountingAI evaluationAuditCorporate financeEnglishExpert review
Documents
Remote · United States
English
Part-time · Flexible
Hourly · $100/hr

Posted Sep 30, 2026