Skip to content
OpenTrain AIFor AI Companies

Psychologist AI Evaluation Expert

Apply now

Job details

Pay

$90–$155 USD/hr

Engagement

Contract

Location

Remote

95 countries

Posted

Nov 5, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a psychologist AI evaluation expert to create and assess clinical and behavioral scenarios used to test model judgment and safety. This contractor role combines professional psychological expertise with hands-on evaluation of AI-generated responses, with a focus on clinical accuracy, ethical reasoning, and safe risk handling.

What you will do
- Author realistic clinical vignettes that include risk assessment and ethical dilemmas
- Write reference responses that explain the clinical reasoning and safety framing behind each decision
- Grade model outputs for clinical accuracy, ethics, and risk handling
- Identify responses that are fluent and empathetic in tone but incorrect about risk, then explain precisely why
- Apply professional judgment to evaluation data used to measure and improve model performance

Required skills
- Doctorate in psychology, either a PhD or PsyD
- Active, unencumbered US psychologist license
- At least two years of clinical or research practice after licensure
- Depth in assessment, psychotherapy, or psychological testing
- Experience with risk assessment and safety planning
- Ability to write clinical reasoning clearly enough for another psychologist to follow

Helpful background
Board certification through ABPP, an academic appointment, crisis intervention or suicide prevention protocol experience, peer-reviewed publications, and clinical supervision experience are helpful backgrounds for this work.

Work arrangement
This is independent contractor work that is fully remote and asynchronous. The engagement is ongoing rather than limited to a single batch of tasks, with a minimum commitment of 10 hours per week and flexibility to scale your hours from week to week.

Compensation
The advertised hourly range is $90 to $155, paid weekly via Stripe. Your rate is set according to experience, and the work does not use fixed hours, screen recording, keystroke monitoring, or idle timers.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • Albania
  • Algeria
  • Antigua and Barbuda
  • Armenia
  • Australia
  • Austria
  • Bahamas
  • Bahrain
  • Belgium
  • Benin
  • Bhutan
  • Bosnia and Herzegovina
  • Botswana
  • Brunei
  • Bulgaria
  • Canada
  • Costa Rica
  • Côte d’Ivoire
  • Croatia
  • Cyprus
  • Czechia
  • Denmark
  • Ecuador
  • El Salvador
  • Estonia
  • Ethiopia
  • Finland
  • France
  • Gambia
  • Germany
  • Greece
  • Guatemala
  • Guyana
  • Hong Kong
  • Hungary
  • Iceland
  • India
  • Indonesia
  • Ireland
  • Israel
  • Italy
  • Jamaica
  • Jordan
  • Kenya
  • Kuwait
  • Latvia
  • Liechtenstein
  • Lithuania
  • Luxembourg
  • Madagascar
  • Malaysia
  • Malta
  • Mauritius
  • Mexico
  • Moldova
  • Mongolia
  • Morocco
  • Mozambique
  • Namibia
  • Netherlands
  • New Zealand
  • North Macedonia
  • Norway
  • Oman
  • Pakistan
  • Panama
  • Peru
  • Philippines
  • Poland
  • Portugal
  • Qatar
  • Romania
  • Rwanda
  • Saint Lucia
  • Senegal
  • Serbia
  • Singapore
  • Slovakia
  • Slovenia
  • South Africa
  • Spain
  • Sri Lanka
  • Sweden
  • Switzerland
  • Taiwan
  • Tanzania
  • Thailand
  • Trinidad and Tobago
  • Tunisia
  • Türkiye
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw3pw9tp006e07jpmyyyyc7s

Keep exploring

Similar open roles

View all AI training jobs

Social Services AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

case managementconfidentialitycritical thinkingwritten communicationverbal communication
Text
Remote · Canada, United States
English
Part-time · Flexible
Hourly · $20–$80/hr

Posted Nov 19, 2026

Clinical Psychology AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $90/hr

Posted Nov 6, 2026

Psychology LLM Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $55/hr

Posted Nov 5, 2026

Psychology AI Research Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $85/hr

Posted Nov 5, 2026

Civilian Intelligence Agency AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

intelligence analysisprogram managementorganizational decision-makingcybersecuritystrategic planningscenario evaluation
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Mid-Senior level
Hourly · $80–$170/hr

Posted Oct 30, 2026