About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting Psychology LLM Evaluation Experts to develop domain-specific prompts, research psychology topics with AI assistance, and evaluate large language model responses. This role supports AI training work focused on improving models' scientific and language understanding in specialized psychology domains. Work is remote and asynchronous, with flexible participation and project placement based on available assignments. The opportunity pays up to $55 per hour.
What you will do
- Create prompts that test understanding of psychology concepts and specialized subject areas
- Evaluate LLM responses for the quality and accuracy of their explanations
- Research topics of interest with assistance from AI tools
- Complete domain-focused tasks designed to test scientific and language understanding
- Apply disciplinary judgment and research expertise when assessing model outputs
Required skills
- Master's degree from a US institution
- Advanced knowledge of psychology and the ability to explain important concepts clearly
- Disciplinary or research expertise in a specialized psychology area
- Ability to work independently in a primarily asynchronous setting
- Strong judgment when comparing model responses with accurate domain understanding
Helpful background
Experience developing domain-specific prompts, evaluating AI-generated responses, or conducting psychology research can help you contribute effectively.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.