About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Member of Technical Staff focused on coding agent research and evaluation. You will work at the intersection of software engineering, AI research, and model evaluation, creating rigorous methods and data systems that show how coding agents perform across software engineering tasks.
What you will do
You will design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards. You will lead research initiatives that measure coding model performance, develop datasets and golden examples, analyze model behavior and failure modes, and translate findings into improvements for training and evaluation. You will also build tooling and infrastructure for experimentation, data generation, review workflows, and evaluation pipelines. The role includes establishing reproducible assessment practices and communicating results through technical reports, benchmark studies, and research initiatives.
Required skills
You should have strong software engineering experience with Python, C++, or a comparable programming language, along with at least three years of experience in software engineering, machine learning, AI research, evaluation, or a related technical discipline. Relevant experience includes designing, reviewing, or validating technical assessments, benchmarks, coding tasks, or evaluation methodologies. Familiarity with large language models, coding agents, reinforcement learning, or related AI systems is important, as are strong analytical, automation, and technical communication skills.
Helpful background
Experience with frontier AI systems, agentic workflows, tool use, post-training methods, machine learning benchmarks, or large-scale datasets is helpful. Publications, open-source contributions, or demonstrated technical leadership in AI, machine learning, or software engineering are also valued.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 2 screening questions.