Skip to content
OpenTrain AIFor AI Companies

AI Product Evaluator

Apply now

Job details

Pay

$14–$36 USD/hr

Engagement

Contract, part-time

Location

Remote

3 countries

Posted

Oct 16, 2026

OpenTrain on Trustpilot

The work

You will test AI models and agents by following detailed scenarios and project guidelines. Your evaluations will examine accuracy, reasoning, and responsiveness, with results recorded for AI training work.

  • Evaluate AI models and agents against defined scenarios.
  • Carry out operational tasks that test accuracy and reasoning.
  • Record findings, observations, and unusual results in structured reports.
  • Reset usage limits and repeat evaluations according to project instructions.
  • Record and submit evaluation datasets on AI training platforms.
  • Maintain careful, consistent work during repetitive or high-volume tasks.

Requirements

The role suits people who can follow detailed instructions accurately and stay thorough during repeated tasks.

  • Language: Professional fluency in English.
  • Experience: Experience with AI products, models, or AI agent evaluation and testing.
  • Follow complex instructions with precision and consistency.
  • Show exceptional attention to detail and operational thoroughness.
  • Work comfortably within strict timeframes during repetitive or high-volume tasks.
  • Skills: AI Models, AI Agents, Following Instructions, Attention to Detail

Open to applicants in

  • India
  • Japan
  • United Kingdom

Preferred

  • Helpful background: Digital product testing, software quality assurance, or AI research.
  • Helpful background: Regular daily use of AI tools and models.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form. It asks for your resume again, your LinkedIn profile, your phone number, your location and answers to 7 screening questions.
  3. Take a short AI interview.

Job ID: cmvb2h3w1000407jq7w65eajw

Keep exploring

Similar open roles

View all AI training jobs

Physics Expert (Gravity and Holography)

Apply advanced physics knowledge to solve, review, and explain challenging problems in gravity, cosmology, and holography. This part-time contract role pays $100 to $170 per hour.

General RelativityCosmologyHolographyQuantum Field TheoryString TheoryLaTeX
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $100–$170/hr

Posted Nov 14, 2026

Physics Expert (Quantum Optics and Atomic Physics)

Review and improve research-level AI training benchmarks in quantum optics and atomic physics. This remote contractor role offers flexible scheduling and pays $100 to $170 per hour.

Quantum OpticsAtomic PhysicsQuantum SensingOptical LatticesLaser PhysicsLaTeX
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $100–$170/hr

Posted Nov 14, 2026

Physics Expert (PhD / Postdoc)

Apply advanced physics expertise to solve, audit, and adjudicate research-level benchmark problems remotely and asynchronously for $100 to $170 per hour. A PhD or postdoctoral background and LaTeX proficiency are required.

PhysicsTheoretical PhysicsMathematical PhysicsQuantum PhysicsLaTeX
Generative AI & RLHF
Document
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $100–$170/hr

Posted Nov 14, 2026

QC Packaging Engineer for AI Evaluation

Review AI data, model evaluation, and task-generation workflows as a remote QC Packaging Engineer. This three-month contractor assignment requires at least 20 hours per week and technical software engineering judgment.

QAQuality Management
Generative AI & RLHF
Text
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible

Posted Nov 13, 2026

Ground Combat & Special Operations SME

Review AI responses to ground combat and special-operations case studies, focusing on tactical reasoning, uncertainty, lawful boundaries, and operational value. This remote part-time contractor role pays $75 to $130 per hour.

CombatSpecial Opstactical operations
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $75–$130/hr

Posted Nov 13, 2026