Skip to content
OpenTrain AIFor AI Companies

Research Evaluation Specialist (PhD or Masters)

Review AI outputs, write challenging research questions, and explain expert judgments in a flexible research evaluation role. Pay is $30 to $60 per hour equivalent, paid per task that meets the project specifications.

Apply now
OpenTrain AI

Generative AI & RLHF

Remote Per task · $30–$60/hr equivalent

$30–$60/hr

equivalent, paid per accepted task

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 20, 2026

Posted

Open in 51 countries

United States
+ more
  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United States
  • Uzbekistan
  • Vietnam

The work

You will support advanced research AI evaluation by creating and improving expert responses, questions, answers, citations, and review materials. Your work will help AI systems learn from careful research and clear human feedback.

You will review source materials and model outputs against project guidelines, explain your judgments, and keep your reviews consistent across repeated tasks.

  • Write or improve expert responses and explain your reasoning clearly.
  • Create challenging, original, and methodologically sound research questions.
  • Review source materials and AI model outputs against project guidelines.
  • Use authoritative references and triangulate information where needed.
  • Give clear feedback that can improve model behavior.
  • Maintain consistent quality across repeated review tasks.

What it pays and takes

This is expert-level, part-time contract work for people with strong research backgrounds and deep subject knowledge. Prior experience in AI training, data labeling, or model evaluation is required.

  • Pay: $30 to $60 per hour equivalent, paid per task that meets the project specifications.
  • Schedule: Approximately 15 hours per week, with minimum weekly task submissions.
  • Estimated project earnings: $3,600 to $7,200 based on the hourly-equivalent rate and the schedule and duration shown on OpenTrain.
  • Location: Open to candidates in Algeria, Argentina, Austria, Bahrain, Bangladesh, Belgium, Brazil, Canada, Chile, Colombia, Denmark, Egypt, France, Germany, Ghana, Greece, India, Indonesia, Italy, Japan, Jordan, Kazakhstan, Kenya, Kuwait, Kyrgyzstan, Lebanon, Malaysia, Mexico, Morocco, the Netherlands, Nigeria, Oman, Pakistan, Palestinian Territories, Peru, the Philippines, Portugal, Qatar, Saudi Arabia, Singapore, South Africa, Spain, Sri Lanka, Switzerland, Taiwan, Thailand, Tunisia, the United Arab Emirates, the United States, Uzbekistan, and Vietnam.
  • Language: Strong written communication and professional fluency in English.
  • Education and experience: Completed or active PhD or Masters study, or equivalent research experience as a specialist, researcher, assistant professor, or professor.
  • Research background: A record of scholarly research, deep subject expertise, familiarity with primary literature, and experience finding authoritative references.
  • Work style: Strong analytical thinking, close attention to detail, self-direction, reliability, and the ability to work independently in a remote engagement.

How it works

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 7 screening questions.

About AI training work

OpenTrain helps people find AI training work, build a profile, and start applications in one place. AI training is the human work behind systems that learn from written examples, ratings, reviews, and expert feedback, so people with specialized knowledge can help shape how those systems respond.

Requirements

  • Experience: Expert level
  • Languages: English

Keep exploring

Similar open roles

View all AI training jobs

Product Analytics and Experimentation Expert

Create realistic product analytics problems and detailed answers to evaluate AI systems, drawing on experiments, metrics, retention, and growth. Remote contract work pays $115 per hour and requires at least 20 hours per week.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Part-time · Flexible
Hourly · $115/hr

Posted Nov 6, 2026

Plumber Expert for Plumbing Diagnosis and Code Compliance

Create plumbing service scenarios, explain code-based diagnoses, and rate AI answers for safety and workmanship. Remote US contract work pays $50 to $90 per hour and requires an active journeyman or master plumber license.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Hourly · $50–$90/hr

Posted Nov 6, 2026

Mortgage Loan Officer AI Evaluation Expert (English)

Create mortgage lending scenarios and assess AI answers against agency and regulatory guidelines. This remote role pays $70 to $105 per hour and requires an active NMLS license or registration.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Part-time · Flexible
Hourly · $70–$105/hr

Posted Nov 6, 2026

Bilingual Audio Contributor and Expert Reviewer (Mandarin)

Review AI-generated research tables, verify linked sources, and find missing entries in a remote, self-paced project requiring 20+ hours weekly. Fluency in Mandarin Chinese and English is required.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
Chinese
Part-time · Flexible
Hourly pay

Posted Nov 6, 2026

Machine Learning Research Evaluation Expert

Create and solve machine learning research problems, then write reference answers that reveal flawed methods and weak conclusions. This remote contractor role pays $115 per hour and requires at least 20 hours per week.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Part-time · Flexible
Hourly · $115/hr

Posted Nov 6, 2026