About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Machine Learning AI Training Task Designer to create demanding technical tasks for advanced AI systems and evaluate the work those systems produce. You will turn practical machine learning expertise into clear task instructions, reproducible environments, reference solutions, and objective standards for correctness. The work combines technical problem design with careful assessment of model-generated code, experiments, analyses, and other machine learning deliverables.
What you will do
Create realistic machine learning engineering tasks that challenge advanced AI models. Develop reproducible environments, reference solutions, evaluation criteria, rubrics, and graders. Evaluate model-generated code, experiments, analyses, and technical deliverables. Identify data leakage, incorrect validation, unstable training, performance problems, and reproducibility issues. Review technical submissions against clear project specifications and quality requirements.
Required skills
Candidates should have prior paid experience training, evaluating, benchmarking, or improving AI systems, along with strong practical Python proficiency. Hands-on experience with PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or comparable machine learning tools is required. The role also requires the ability to establish objective standards for correct technical solutions and provide substantive public technical evidence through repositories, model implementations, competition results, publications, technical reports, benchmarks, or open-source contributions.
Helpful background
Experience creating AI-training tasks, reference answers, rubrics, graders, or benchmark problems is valuable. Experience reviewing technical submissions, achieving strong results in technical competitions, contributing to machine learning research or open source, and evaluating long-horizon or agentic AI systems can further support success in the role.
Schedule and compensation
This is a fully remote contractor opportunity with a flexible schedule and a commitment of at least 15 hours per week. Compensation is output-based and tied to accepted tasks.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.