Skip to content
OpenTrain AIFor AI Companies

Psychology Expert AI Model Evaluation

Apply now

Job details

Pay

$85 USD/hr

Engagement

Contract

Location

Remote

United States only

Posted

Nov 5, 2026

OpenTrain on Trustpilot

The work

You will help evaluate how well large language models understand and explain psychology. Your work will combine prompt writing, research, response review, and clear explanations of where AI outputs meet or miss expert standards.

  • Write prompts based on psychology concepts, research areas, and subfields.
  • Review AI-generated responses for scientific accuracy and clear language.
  • Research psychology topics with AI support and use the findings in your task responses.
  • Explain important psychology concepts clearly.
  • Identify errors or gaps in an AI model's subject-matter understanding.
  • Contribute to research tasks that test and improve specialized AI capabilities.

Requirements

This is remote, asynchronous project work. Assignments are available throughout the year depending on work in your subject area.

  • Hours: Flexible, with no minimum hour commitment.
  • Language: Professional fluency in English.
  • Education: Master's degree from an institution in the United States.
  • Expertise: Strong psychology knowledge and disciplinary research experience.
  • Skills: Explain psychology concepts precisely and assess the accuracy of AI-generated responses.
  • Work style: Able to work independently in a primarily asynchronous setting.

Open to applicants in

  • United States

Preferred

  • Helpful background: Doctoral study or a completed doctorate in psychology, especially in an emerging research area.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmw3tul3l00c508l340dxkfv1

Keep exploring

Similar open roles

View all AI training jobs

Trade Compliance Expert AI Evaluator

Use trade compliance expertise to create expert tasks, assess AI-generated answers, and give clear feedback on reporting, export controls, sanctions, and audits. This ongoing remote role pays up to $80 per hour with no set schedule.

Generative AI & RLHF
Text
Remote · United States
English
Flexible hours
Hourly · $80/hr

Posted Nov 16, 2026

Hardware Expert AI Training Specialist

Create, solve, and evaluate rigorous hardware engineering problems for AI training from anywhere, with a flexible commitment of about 15 hours per week. Pay is $60 to $120 per hour equivalent, paid per task that meets the project specifications.

RTLHardware
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

STEM Expert for AI Problem Evaluation

Solve scientific and technical problems, use Python for calculations or simulations, and review AI-generated answers for accuracy. This flexible role offers approximately 15 hours per week and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Biology
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

AI Agent Evaluator

Test AI agents on realistic smartphone tasks such as bookings, shopping, payments, and forms. Earn $25 to $45 per hour on a flexible schedule, with each run taking about 1.5 hours.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United States
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026

AI Agent Tester

Test two AI agents on realistic tasks such as bookings, shopping, forms, and follow-ups. Record each attempt, score performance, and write clear feedback from a real user’s perspective.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026