About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a psychologist AI evaluation expert to create and assess clinical and behavioral scenarios used to test model judgment and safety. This contractor role combines professional psychological expertise with hands-on evaluation of AI-generated responses, with a focus on clinical accuracy, ethical reasoning, and safe risk handling.
What you will do
- Author realistic clinical vignettes that include risk assessment and ethical dilemmas
- Write reference responses that explain the clinical reasoning and safety framing behind each decision
- Grade model outputs for clinical accuracy, ethics, and risk handling
- Identify responses that are fluent and empathetic in tone but incorrect about risk, then explain precisely why
- Apply professional judgment to evaluation data used to measure and improve model performance
Required skills
- Doctorate in psychology, either a PhD or PsyD
- Active, unencumbered US psychologist license
- At least two years of clinical or research practice after licensure
- Depth in assessment, psychotherapy, or psychological testing
- Experience with risk assessment and safety planning
- Ability to write clinical reasoning clearly enough for another psychologist to follow
Helpful background
Board certification through ABPP, an academic appointment, crisis intervention or suicide prevention protocol experience, peer-reviewed publications, and clinical supervision experience are helpful backgrounds for this work.
Work arrangement
This is independent contractor work that is fully remote and asynchronous. The engagement is ongoing rather than limited to a single batch of tasks, with a minimum commitment of 10 hours per week and flexibility to scale your hours from week to week.
Compensation
The advertised hourly range is $90 to $155, paid weekly via Stripe. Your rate is set according to experience, and the work does not use fixed hours, screen recording, keystroke monitoring, or idle timers.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.