About OpenTrain. OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role. OpenTrain is recruiting a Psychology Behavioral Science Evaluator to create and assess behavioral science scenarios used to test AI model judgment. You will author realistic scenarios from study design through interpretation, write reference answers grounded in methodological reasoning, and evaluate model outputs for construct validity, inference quality, replication awareness, and appropriate treatment of evidence.
What you will do. You will weigh constructs, confounds, effect sizes, and methodological limitations when developing reference answers. You will identify plausible-sounding claims that overstate what the evidence supports and provide clear, teachable reasoning about behavioral research methods.
Required skills. You should have an advanced degree in psychology or a closely related behavioral science and at least two years of research experience with human subjects or behavioral data. A working command of study design, measurement, and statistical inference is required, along with strong written English and the ability to explain methodological judgment clearly. Academic, UX research, and applied behavioral science experience are relevant.
Schedule and pay. This is fully remote, asynchronous contractor work with a minimum commitment of 10 hours per week and no maximum. Work can scale up or down from week to week. The source lists compensation at $60 to $120 per hour, with a separate listed rate of $90 per hour, paid weekly via Stripe. The engagement is ongoing rather than a fixed-length project.
Why work with OpenTrain. OpenTrain helps freelancers consolidate AI training opportunities across platforms and build a durable AI training portfolio. This role lets your expertise shape evaluations of whether AI systems can reason responsibly about human behavior, research methods, and evidence.