Skip to content
OpenTrain AIFor AI Companies

Software Engineering AI Evaluation Specialist

Evaluate AI models on complex software engineering problems by building coding environments, reference solutions, and expert reviews. Pay is $50 to $100 per hour equivalent, paid per task that meets the project specifications.

Apply now

How the AI interview works

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.
  3. If you are shortlisted, you are invited to an AI interview.

What to expect

  • It is a conversational interview with an AI recruiter.
  • You can take it any time, from anywhere.
  • It asks open-ended technical questions based on the role, and scenario questions on how you think, solve problems and communicate.
  • Technical roles include a coding challenge.
  • You see right away whether you meet the certification criteria. If you do not, you can ask for feedback.
OpenTrain AI

Coding & Software

Remote Per task · $50–$100/hr equivalent

$50–$100/hr

equivalent, paid per accepted task

Compensation

Contract, part-time

Engagement

Remote

Location

Sep 7, 2026

Posted

Open in 52 countries

United States
+ more
  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

The Work

You will create reproducible environments that test AI models on realistic software engineering problems. You will also develop reference solutions and contribute code, debugging methods, and technical explanations for AI training data.

  • Build environments and reference solutions for coding problems.
  • Analyze defects and performance bottlenecks in varied codebases.
  • Implement maintainable features and improve legacy code for clarity, efficiency, and reliability.
  • Document technical reasoning, solution approaches, and code decisions.
  • Review and validate other contributors’ code and technical submissions for accuracy and clarity.

What It Pays and Takes

This part-time contractor role focuses on software engineering code evaluation. Previous AI experience is not required, but you need strong hands-on software engineering ability and clear technical communication.

  • Pay: $50 to $100 per hour equivalent, paid per task that meets the project specifications.
  • Time: Approximately 15 hours per week, with less than 20 hours per week expected.
  • Location: Open to candidates in the countries specified for this role.
  • Language: Professional fluency in English.
  • Programming: Significant hands-on expertise in at least one of Python 3, Java, Rust, Go, C++, or TypeScript.
  • Knowledge: Strong understanding of algorithms, data structures, and software engineering principles.
  • Experience: Ability to debug complex systems, resolve defects, improve performance, and refactor large or legacy codebases.
  • Communication: Ability to explain technical concepts and document engineering decisions clearly.
  • Helpful background: Experience delivering features from start to finish in cross-functional projects and interest in how AI systems handle coding challenges.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that learn from examples. Software engineering specialists help by creating and reviewing coding tasks, solutions, and evaluations so models can improve at fixing code, building features, and reasoning about software.

Requirements

  • Experience: Mid-Senior level
  • Languages: English

Ready to apply?

Create a free OpenTrain account and apply for this role in minutes.

Keep exploring

Similar open roles

View all AI training jobs

Rust Architect / Backend Developer

Work on AI training projects that test Rust backend systems, APIs, concurrency, infrastructure, and reliability. This remote contractor role offers flexible work of about 15 hours per week.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Entry level

Posted Oct 24, 2026

Machine Learning Researcher and Task Reviewer

Review and validate machine learning engineering tasks involving Python, models, numerical computing, and system performance. This remote contractor role offers $60 to $120 per hour equivalent, paid per task that meets the project specifications, with about 15 flexible hours per week.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Mid-Senior level
Per task · $60–$120/hr equivalent

Posted Oct 23, 2026

Machine Learning Applied Scientist

Build and validate machine-learning models, training pipelines, inference systems, and numerical methods remotely for about 15 flexible hours per week. Compensation is $60 to $120 per hour equivalent, paid per task that meets the project specifications.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +48 more
English
Part-time · Flexible
Entry level
Per task · $60–$120/hr equivalent

Posted Oct 23, 2026

Mathematics and Computational AI Training Expert

Solve, code, and validate advanced mathematical tasks for AI training using Python and scientific computing tools. Pay is $60 to $120 per hour equivalent, paid per task that meets the project specifications, with about 15 flexible hours each week.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +48 more
English
Part-time · Flexible
Entry level
Per task · $60–$120/hr equivalent

Posted Oct 22, 2026

Life Sciences Research Expert (Python)

Create, solve, and review life sciences research problems for AI evaluation using Python, scientific data analysis, modeling, and code review. Pay is $60 to $120 per hour equivalent, paid per task that meets the project specifications, with about 15 flexible hours per week.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Entry level
Per task · $60–$120/hr equivalent

Posted Oct 21, 2026