Skip to content
OpenTrain AIFor AI Companies

AI Evaluation Specialist (LLM)

Apply now

Job details

Pay

$17 USD/hr

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Sep 30, 2026

OpenTrain on Trustpilot

The work

You will test large language models and assess how well they perform. The work is remote, independent, and primarily asynchronous, with detailed instructions to follow during short-term AI training projects.

  • Test large language models with AI research teams.
  • Use general academic knowledge and reasoning to assess model performance.
  • Review model behavior carefully and identify areas for improvement.
  • Follow detailed instructions accurately while completing evaluation tasks.
  • Work independently in a remote, primarily asynchronous setting.
  • Build practical experience that may support eligibility for additional AI training projects.

Requirements

This is a part-time freelance contractor role for candidates in the United States. All academic disciplines are welcome, and no specific professional or AI training experience is required.

  • Time: 20+ hours per week.
  • Language: Fluent English.
  • Education: Currently enrolled in or have completed an associate, bachelor's, or master's degree program.
  • Skills: Strong reasoning, careful judgment, exceptional attention to detail, and consistent accuracy.
  • Work style: Comfortable working independently in a remote and primarily asynchronous setting.
  • Training: Open to brief training and learning new evaluation workflows.

Open to applicants in

  • United States

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

Job ID: cmuo59mz900000agm4uziuwfz

Keep exploring

Similar open roles

View all AI training jobs

Physics Expert (Gravity and Holography)

Apply advanced physics knowledge to solve, review, and explain challenging problems in gravity, cosmology, and holography. This part-time contract role pays $100 to $170 per hour.

General RelativityCosmologyHolographyQuantum Field TheoryString TheoryLaTeX
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $100–$170/hr

Posted Nov 14, 2026

Physics Expert (Quantum Optics and Atomic Physics)

Review and improve research-level AI training benchmarks in quantum optics and atomic physics. This remote contractor role offers flexible scheduling and pays $100 to $170 per hour.

Quantum OpticsAtomic PhysicsQuantum SensingOptical LatticesLaser PhysicsLaTeX
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $100–$170/hr

Posted Nov 14, 2026

Physics Expert (PhD / Postdoc)

Apply advanced physics expertise to solve, audit, and adjudicate research-level benchmark problems remotely and asynchronously for $100 to $170 per hour. A PhD or postdoctoral background and LaTeX proficiency are required.

PhysicsTheoretical PhysicsMathematical PhysicsQuantum PhysicsLaTeX
Generative AI & RLHF
Document
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $100–$170/hr

Posted Nov 14, 2026

Ground Combat & Special Operations SME

Review AI responses to ground combat and special-operations case studies, focusing on tactical reasoning, uncertainty, lawful boundaries, and operational value. This remote part-time contractor role pays $75 to $130 per hour.

CombatSpecial Opstactical operations
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $75–$130/hr

Posted Nov 13, 2026

Contract Specialist, Federal Procurement AI Evaluation

Use federal procurement expertise to create contracting tasks, review AI-generated work for FAR compliance, and build benchmark examples. This remote U.S. contractor role pays $60 to $80 per hour.

Federal ContractingContract NegotiationPre-Award and Post-Award ProceduresGS-1102ProcurementProposal Evaluation
Generative AI & RLHF
Document
Remote · United States
English
Part-time · Flexible
Hourly · $60–$80/hr

Posted Nov 13, 2026