ML Engineer Coding Agent Reviewer

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people start and grow careers teaching AI by centralizing projects, tracking work, and building a professional AI training portfolio.

Creating an OpenTrain account is free. Our platform makes it easier to find specialized, flexible contract work that directly shapes how modern AI systems behave.

Why AI training work matters

AI training (data labeling and human evaluation) is the human side of building state-of-the-art AI. Contributors provide the examples, reviews, and professional judgment that models learn from and that product teams rely on to improve model quality.

This line of work is remote-friendly, often part-time and flexible, and offers hands-on experience with frontier models and real-world ML engineering problems.

The role

We are recruiting ML Engineer Coding Agent Reviewers to evaluate model-generated machine learning implementations and MLOps workflows. This is hands-on technical evaluation work for experienced ML engineers who can judge correctness, performance, and engineering tradeoffs.

You will work as a contractor on part-time schedules (20+ hours/week), performing structured reviews and comparisons across coding agents and frontier models.

What you'll do

• Review AI-generated machine learning implementations for correctness, clarity, and reliability.
• Evaluate training and inference systems, MLOps pipelines, and LLM application workflows.
• Identify bugs, edge cases, performance bottlenecks, and failure modes in model-produced code.
• Compare outputs and implementations from multiple frontier coding models and agents.
• Apply professional ML engineering judgment to assess technical tradeoffs and recommend improvements.

Requirements

You must be able to perform detailed technical reviews of code and ML systems; we will rely on your engineering experience and domain judgment.

• 2+ years of professional machine learning engineering experience.
• Hands-on experience building production ML systems or deployment infrastructure.
• Experience reviewing model-generated machine learning code.
• Familiarity with AI coding agents such as Cursor, Claude Code, Codex, Windsurf, or Gemini CLI.
• Ability to evaluate technical tradeoffs in model-generated implementations and MLOps workflows.
• Preferred: prior experience deploying ML systems to production.

Who should apply

Experienced ML engineers, MLOps engineers, and engineering reviewers who are comfortable reading and critiquing model-produced code and system designs should apply.

This role is suited to people who enjoy structured evaluation work, can document nuanced technical issues, and want to influence how frontier coding agents perform on real engineering tasks.

Compensation, schedule, and logistics

This is a contractor, part-time role requiring 20+ hours per week. Work is remote and open worldwide; English fluency is required.

Pay is hourly at USD 85. The label/task type for this project is evaluation/rating of computer code and programming outputs.

• Employment type: Contractor, Part-time.
• Time requirement: 20+ hours/week.
• Pay: $85/hour (USD).
• Languages: English required.
• Data type: Computer code / programming; Label type: Evaluation rating.

How to apply and next steps

Create a free OpenTrain account, complete your profile with relevant ML engineering experience, and apply through the platform. Candidates who match requirements will be invited to a technical evaluation and onboarding for the project.

Successful contractors receive structured tasks and guidance for scoring model outputs; your reviews help improve model quality across real ML engineering scenarios.