Psychology Expert (LLM Evaluation)

You will help evaluate how well large language models understand psychology. The work combines prompt writing, psychology research with AI tools, and careful review of model responses.

You will use your psychology knowledge to judge whether explanations are accurate, clear, and relevant to specialized topics.

• Write prompts that test psychology concepts and specialized subject areas.
• Evaluate AI-generated responses for quality and accuracy.
• Research psychology topics with assistance from AI tools.
• Complete tasks that test scientific and language understanding.
• Apply research expertise and disciplinary judgment when comparing model responses with accurate psychology knowledge.

What it pays and takes

This is remote, asynchronous contract work with flexible participation based on available assignments. The role is intended for people who can work independently and contribute at least 20 hours per week.

• Pay: up to $55 per hour.
• Hours: 20+ hours per week.
• Location: open to candidates in the United States.
• Language: professional fluency in English.
• Education: master's degree from a US institution.
• Advanced knowledge of psychology and the ability to explain important concepts clearly.
• Disciplinary or research expertise in a specialized psychology area.
• Strong judgment when assessing AI-generated responses.
• Ability to work independently in an asynchronous setting.
• Experience with domain-specific prompts, AI response evaluation, or psychology research is helpful.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human-written examples and reviews to improve how artificial intelligence understands and responds to information. Psychology experts are paid for this work because their subject knowledge helps identify accurate, useful, and well-reasoned model responses.