Skip to content
OpenTrain AIFor AI Companies

Psychology LLM Evaluation Expert

Apply now

Job details

Pay

$55 USD/hr

Engagement

Contract

Location

Remote

United States only

Posted

Nov 5, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting Psychology LLM Evaluation Experts to develop domain-specific prompts, research psychology topics with AI assistance, and evaluate large language model responses. This role supports AI training work focused on improving models' scientific and language understanding in specialized psychology domains. Work is remote and asynchronous, with flexible participation and project placement based on available assignments. The opportunity pays up to $55 per hour.

What you will do
- Create prompts that test understanding of psychology concepts and specialized subject areas
- Evaluate LLM responses for the quality and accuracy of their explanations
- Research topics of interest with assistance from AI tools
- Complete domain-focused tasks designed to test scientific and language understanding
- Apply disciplinary judgment and research expertise when assessing model outputs

Required skills
- Master's degree from a US institution
- Advanced knowledge of psychology and the ability to explain important concepts clearly
- Disciplinary or research expertise in a specialized psychology area
- Ability to work independently in a primarily asynchronous setting
- Strong judgment when comparing model responses with accurate domain understanding

Helpful background
Experience developing domain-specific prompts, evaluating AI-generated responses, or conducting psychology research can help you contribute effectively.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw3tulyn00c908l32giullq1

Keep exploring

Similar open roles

View all AI training jobs

Computer Science LLM Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $75/hr

Posted Nov 5, 2026

Business Data Expert for LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $105/hr

Posted Nov 5, 2026

LLM Evaluation Specialist

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $17/hr

Posted Sep 30, 2026

ML Engineer - LLM & Agentic Evaluations

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonLLM
Text
Remote · Argentina, Belize, Bolivia +20 more
English
Part-time · Flexible

Posted Nov 18, 2026

ML Engineer, LLM and Agentic Evaluations

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonLLM
Text
Remote · India, Pakistan, Türkiye
English
Part-time · Flexible

Posted Nov 18, 2026