STEM AI Coding Agent Evaluator

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. We help contributors discover specialized projects, build a professional AI-training profile, and grow their experience in a rapidly developing industry.

• Remote contractor opportunity
• Worldwide eligibility
• Part-time schedule of 20+ hours per week
• Compensation of $80–$100 per hour

About AI Coding Agent Evaluation

AI training is the human side of building artificial intelligence. In this work, technical experts review AI-generated outputs, assess how systems perform in realistic settings, and provide structured feedback that helps models and coding agents improve their reasoning and task execution.

• Work directly with cutting-edge AI systems
• Apply real-world technical expertise to model evaluation
• Help shape how AI coding agents perform on complex tasks

The Role

OpenTrain AI is recruiting a STEM AI Coding Agent Evaluator to support AI training focused on coding-agent evaluation. You will examine AI coding-agent sessions and technical workflows, document performance and outcomes, and turn your expertise into clear feedback and structured insights.

Prior AI training experience is not required. The most important qualification is strong real-world professional or academic STEM knowledge combined with hands-on experience applying AI coding agents in technical settings.

• Contractor position
• Part-time engagement
• Asynchronous work involving independent documentation and feedback
• Collaboration with project coordinators

What You'll Do

You will evaluate realistic uses of AI coding agents in complex STEM projects and explain how well they perform in context. Your work will combine technical investigation, careful documentation, and actionable written and verbal feedback.

• Evaluate and document AI coding-agent use in complex STEM projects.
• Analyze workflows, technical challenges, tools, methodologies, and outcomes.
• Provide detailed written and verbal feedback on agent strengths, limitations, and context-specific performance.
• Contribute examples, insights, and structured data that can improve AI-agent reasoning and task execution.
• Collaborate asynchronously with project coordinators to clarify deliverables and refine task guidelines.

Required Skills And Experience

This role is listed at the entry level, but it requires substantive STEM expertise and hands-on experience using multiple AI coding agents in real technical work. You should be comfortable investigating ambiguous or large-scale challenges, reviewing technical work, and clearly explaining your decisions.

• Relevant professional or academic STEM expertise.
• Hands-on experience applying AI coding agents in technical settings.
• Familiarity with multiple AI coding agents, tools, or frameworks beyond basic autocomplete or code suggestions.
• Experience with large codebases, system-level architecture, debugging, or innovative technical problem-solving.
• Ability to handle complex, ambiguous, or large-scale technical challenges using AI tools.
• Experience directing, reviewing, testing, or validating AI-generated technical work.
• Strong written and verbal communication, with careful attention to clarity and thoroughness.
• Ability to work independently, document technical decisions, and provide actionable feedback.

Schedule And Compensation

This is asynchronous contractor work involving independent documentation, feedback, and collaboration with project coordinators. The expected time commitment is 20+ hours per week.

• Pay: $80–$100 per hour
• Work arrangement: Remote and asynchronous
• Time requirement: 20+ hours per week
• Working language: English

Build Your AI Training Career

Every major AI system depends on people who can evaluate examples, review outputs, and explain what good performance looks like. OpenTrain AI gives you a place to develop a credible record of this work, discover projects aligned with your skills, and build a longer-term career in AI training and data labeling.

• Create an OpenTrain account for free.
• Build a profile showcasing your technical expertise and AI-training experience.
• Discover specialized opportunities and apply in minutes.
• Grow a portfolio of work that reflects your contribution to AI development.