Psychology Assessment AI Training Expert

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role. OpenTrain helps people build careers in AI training and data labeling by connecting their expertise with projects that shape how modern AI systems learn, reason, and respond.

As a contributor, you can build a durable AI training portfolio, manage your work in one place, and grow your experience in a fast-expanding area of technology. Creating an OpenTrain account is free.

About AI Training and Assessment Work

AI training is the human side of building artificial intelligence. Specialists create and review examples that help AI systems develop stronger reasoning, accuracy, and understanding. In this project, psychology experts will support gold-standard benchmarks by writing and evaluating challenging assessment content.

The work is fully remote and asynchronous, making it suitable for contributors who want flexible, part-time work while applying advanced academic knowledge to cutting-edge AI research.

The Role

OpenTrain is recruiting a Psychology Assessment AI Training Expert to create and verify high-quality multiple-choice content for an AI research initiative. The subject matter spans psychometrics, digital health, human factors and engineering psychology, consumer and market psychology, neuromorphic engineering, and psychedelic-assisted therapy.

You may author new assessment questions or evaluate pre-written questions for accuracy, clarity, rigor, completeness, precision, and solvability. Questions should test deep conceptual understanding rather than surface recall.

• Contractor and part-time position
• Fully remote and asynchronous
• Worldwide opportunity
• Expected commitment of at least 10 hours per week; the listing indicates 20+ hours per week
• Hourly compensation of $50 to $63 USD

What You'll Do

You will develop rigorous academic assessment items and improve existing content. Each question should be self-contained, unambiguous, precisely defined, and appropriate for its intended level of difficulty.

• Create original, challenging multiple-choice questions across a relevant psychology subdomain
• Assess conceptual understanding at medium, hard, or expert academic levels
• Provide one correct answer and nine plausible but subtly incorrect alternatives
• Write clear, step-by-step solutions for each question
• Support every question with one to five reputable academic references
• Review existing questions for accuracy, clarity, completeness, precision, and solvability
• Make justified edits and document the changes

Required Qualifications

This role requires advanced academic preparation in psychology or a closely related field. You should be comfortable working with graduate-level theory, research methodology, and empirical literature, and able to communicate complex ideas clearly in written English.

• Doctoral training in psychology or a closely related field, including a PhD, PsyD, or current doctoral candidacy
• Strong command of graduate-level psychological theory, research methodology, and empirical literature
• Ability to author challenging, unambiguous multiple-choice questions with defensible alternatives
• Ability to evaluate assessment accuracy, clarity, completeness, precision, and solvability
• Excellent academic writing skills in English
• Familiarity with reputable psychology research references

Helpful Background

A master's degree with exceptional depth in a specific psychology subdomain may be considered. Clinical licensure and published psychology research are valuable additional qualifications.

• Advanced expertise in a relevant psychology subdomain
• Clinical licensure
• Published psychology research

Why Build an AI Training Career

Human expertise remains essential as AI systems become more capable. By writing and reviewing psychology assessments, you can help test whether models understand complex academic concepts instead of merely repeating familiar language.

OpenTrain supports contributors who want to turn specialized project work into a long-term portfolio. Your profile can showcase credible experience, help you find work aligned with your skills, and support continued growth in AI training.

• Apply advanced psychology knowledge to emerging AI systems
• Work remotely with an asynchronous schedule
• Build experience in assessment creation and model evaluation
• Develop a portfolio of specialized AI training work

How to Apply

Create a free OpenTrain account and apply through OpenTrain AI. Highlight your psychology training, relevant subdomain expertise, research background, academic writing ability, and experience creating or evaluating rigorous assessment content.

• Submit your application through OpenTrain
• Showcase relevant doctoral or advanced graduate training
• Describe applicable research, clinical, or assessment experience
• Demonstrate clear written English and familiarity with academic references