Code Generation Model Evaluation Engineer

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people discover cutting-edge projects, build a professional profile, and apply in minutes. Creating an OpenTrain account is free.

• Build a portfolio around specialized AI training and software evaluation work
• Find opportunities that match your technical skills
• Work remotely as part of a fast-growing AI industry

About AI Training and Model Evaluation

AI training is the human side of building artificial intelligence. Engineers and technical reviewers help models improve by creating examples, assessing model outputs, identifying defects, and writing precise feedback. In this role, your programming judgment will directly support the development of better code-generation systems.

• Work with AI-generated code and real-world software
• Assess correctness, quality, and technical reasoning
• Contribute to how modern AI systems generate and evaluate code

The Role

OpenTrain is recruiting a Code Generation and Model Evaluation Research Engineer for collaborative technical work involving software development, coding-task creation, code review, and AI model evaluation. You will apply strong programming, algorithms, and data-structure knowledge to identify defects, assess solution quality, and provide actionable feedback for model training.

This is an entry-level, remote contractor opportunity requiring 20 or more hours per week. The work is conducted in English and is available in the countries listed for this opportunity.

• Employment type: Contractor and part time
• Experience level: Entry level
• Time requirement: 20+ hours per week
• Working language: English

What You’ll Do

You will work across coding workflows and technical evaluation tasks, producing well-documented judgments and high-quality code. Your work may span multiple languages and real-world codebases.

• Analyze, debug, and resolve issues in Python, Java, Rust, C++, Go, and TypeScript codebases
• Contribute to features supporting code-generation workflows
• Refactor and optimize software for performance, maintainability, and adaptability
• Create and review coding tasks used to evaluate AI model performance and accuracy
• Write clear annotations, technical documentation, and written feedback
• Collaborate with technical stakeholders to support robust outputs
• Validate complex code and explain technical judgments clearly

Requirements

You should bring strong programming ability and careful technical judgment. Expertise in competitive programming and coding problem analysis is required, as is strong knowledge of algorithms and data structures in at least one supported programming language.

• Competitive programming expertise, including analysis and evaluation of multiple solution paths
• Strong algorithms and data structures knowledge in at least one of Python, Java, Rust, C++, Go, or TypeScript
• Ability to debug, refactor, optimize, and validate complex code
• Evidence of open-source contributions or collaborative software development
• Ability to create clear coding tasks and explain technical decisions in written feedback
• Strong analytical skills, attention to detail, and clear written and verbal communication
• Ability to work independently in a remote, collaborative environment
• Ability to deliver well-documented, high-quality code

Helpful Background

Experience contributing to competitive programming platforms can strengthen your application, particularly when it demonstrates practical experience evaluating programming solutions.

• Problem setter experience
• Tester or checker experience
• Experience with a major competitive programming platform

Working Arrangement and Compensation

This remote contractor role involves collaborative technical work and requires a minimum of 20 hours per week. The opportunity may include software development, code review, coding-task design, model evaluation, and written technical reasoning.

The compensation information for this opportunity lists USD $50 to $100 per hour. Project terms also describe output-based payment for tasks that meet project specifications, with minimum weekly submission requirements applying.

• Remote contractor opportunity
• 20+ hours per week
• Listed compensation: $50-$100 USD per hour
• Payment is tied to tasks meeting project specifications
• Minimum weekly submission requirements apply

How to Apply Through OpenTrain

Create a free OpenTrain account to build your AI training profile and apply for this opportunity in minutes. Highlight your programming strengths, competitive programming experience, open-source or collaborative development work, and ability to evaluate code with precision.

• Showcase relevant coding languages and technical experience
• Describe open-source contributions or collaborative software projects
• Demonstrate strong algorithms, data structures, and code-review judgment
• Apply remotely through OpenTrain