About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting a Domain Contributor - Evaluation Specialist to create demanding questions and scenarios, assess generated responses, and provide source-grounded feedback that helps improve advanced AI systems. This contractor role supports expert work across history, archival and library science, law, finance, journalism, technology, and related areas.
What you will do
You will design nuanced, domain-specific tasks that probe model limits and reveal reasoning flaws. You will write questions and scenarios requiring deep subject-matter knowledge, validate AI-generated outputs against authoritative primary sources, and explain missed reasoning, factual errors, source problems, and important nuances. You will apply detailed task guidelines and evaluation rubrics consistently and produce clear written and verbal deliverables.
Required skills
You should have hands-on experience with AI model training, annotation, RLHF, or model evaluation, along with deep expertise in history, archival or library science, law, finance, journalism, technology, or a related area. Advanced research ability, experience verifying complex claims against authoritative sources, exceptional written and verbal communication, and careful adherence to detailed instructions are required.
Helpful background
Experience designing adversarial tasks, graduate-level research experience, experience at a Fortune 100 company, or professional fluency in a non-English language is helpful.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.