Skip to content
OpenTrain AIFor AI Companies

Member of Technical Staff, Frontier AI Evaluation Lead

Apply now

Job details

Pay

$115.38–$168.27 USD/hr

Engagement

Contract

Location

Remote

52 countries

Posted

Nov 19, 2026

OpenTrain on Trustpilot

The work

  • Own research and evaluation initiatives from problem framing through data design, quality calibration, and signal validation.
  • Design ML-oriented data systems with task definitions, annotation schemas, rubrics, incentives, and pipelines tied to model performance.
  • Analyze model and system failures to find root causes, edge cases, and opportunities to improve performance.
  • Turn unclear system behavior into evaluation frameworks and new data categories.
  • Work with researchers and domain experts to calibrate quality and strengthen evaluation signals.
  • Iterate on evaluations, datasets, and feedback loops to improve model or agent performance.
  • Make evidence-based quality decisions when data integrity or signal strength is not sufficient.
  • Find gaps in evaluation coverage and recommend where to invest, iterate, or stop.
  • Collaborate with researchers, domain experts, operators, and cross-functional teams to improve evaluation quality and deployed AI systems.

Requirements

  • Time: 20+ hours per week.
  • Language: Professional fluency in English.
  • Experience designing ML-oriented datasets, evaluation frameworks, and quality assurance processes; strong judgment about research signal quality and evidence readiness; the ability to structure messy real-world system behavior into research and evaluation opportunities, explain tradeoffs and limitations clearly, work directly with experts during calibration and iteration, and take a systems-level view of end-to-end model or agent performance.
  • Skills: Research Signal Judgment, ML-Oriented Data Design, Ops-to-Research Translation, RL Environments

Open to applicants in

  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

Preferred

  • Helpful background includes reinforcement learning environments, simulators, feedback-driven training systems, agentic systems, applied research, production systems, complex-task evaluation, or expert incentive design.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form. It asks for your resume again, your LinkedIn profile, your phone number, your location and answers to 4 screening questions.
  3. Take a short AI interview.

OpenTrain on Trustpilot

Job ID: cmwo0bt7z000s07lcwbutofha

Keep exploring

Similar open roles

View all AI training jobs

Enterprise Client Partner (English)

Lead enterprise customer relationships for AI agents and systems, from technical discovery through deployment and account growth. This contractor role pays $67.31 to $86.54 per hour and requires 20+ hours per week.

Client AcquisitionOutbound ProspectingEnterprise ParnershipsEnterprise AI
Generative AI & RLHF
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $67.31–$86.54/hr

Posted Nov 21, 2026

Enterprise Client Partner, Frontier AI (English)

Earn $67.31 to $86.54 per hour in a remote Enterprise Client Partner role focused on frontier AI partnerships, model evaluation, and human-data programs. Work 20+ hours per week and apply through OpenTrain.

Client AcquisitionOutbound ProspectingEnterprise ParnershipsEnterprise AI
Generative AI & RLHF
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $67.31–$86.54/hr

Posted Nov 19, 2026

Enterprise Client Partner, Enterprise AI

Manage strategic enterprise relationships for AI deployments, executive partnerships, commercial agreements, and customer growth. This contractor role pays $67.31 to $86.54 per hour, requires 20+ hours weekly, and is open in listed countries.

Client AcquisitionOutbound ProspectingEnterprise ParnershipsEnterprise AI
Generative AI & RLHF
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $67.31–$86.54/hr

Posted Nov 19, 2026

Question Answer Evaluation Contributor

Review different types of questions and optional answers, choose the correct response, and explain why it is correct. This intermediate contractor role pays $7 to $20 per hour worldwide.

Generative AI & RLHF
Text
Remote · Worldwide
Flexible hours
Intermediate level
Hourly · $7–$20/hr

Posted Nov 21, 2026

AI Content Writer for Remote AI Training

Write AI-generated content, research topics with AI tools, and review AI responses from home. This entry-level contractor role pays $15 to $16 per hour and does not require prior experience.

Generative AI & RLHF
Text
Remote · Worldwide
Flexible hours
Entry level
Hourly · $15–$16/hr

Posted Nov 19, 2026