About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting a Machine Learning Research Evaluation Expert to create expert evaluation data used to measure and improve frontier AI models. You will author and solve realistic analysis problems based on your own machine learning research, then provide reference answers and reasoning that distinguish sound research judgment from plausible but incorrect approaches.
What you will do
Design realistic machine learning research problems involving experiment design, ablations, model evaluation, and failure analysis. Work through each problem to produce a reference answer with clear reasoning for every step. Identify methodological mistakes and research conclusions that may look reasonable but require practical experience to recognize. Apply your judgment to evaluation work focused on your research specialty rather than task volume.
Required skills
A master's or PhD in computer science, statistics, mathematics, or a related field is required. You should have at least three years of full-time machine learning research experience after completing your degree. Postdoctoral research counts, while doctoral study years do not. You should also have hands-on experience designing experiments, running ablations, or evaluating machine learning models, along with strong Python skills and experience with a deep learning framework such as PyTorch or JAX. Clear written English and the ability to explain technical results step by step are important for this work.
Helpful background
Publications at venues such as NeurIPS, ICML, ICLR, ACL, or CVPR are helpful. Experience in an industry research laboratory or university research group is also valued.
Schedule and compensation
This is a fully remote, asynchronous contractor role with no fixed hours. You must be able to commit at least 10 hours per week. The rate is $115 per hour, with weekly payment via Stripe.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.