Skip to content
OpenTrain AIFor AI Companies

Software Engineer, AI Research and Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

You will help create datasets for training and benchmarking large language models. The work involves curating code examples, writing precise solutions, correcting implementations, and evaluating AI-generated software across full-stack applications.

You will use software engineering judgment to assess code quality, efficiency, scalability, reliability, architecture, API design, production implementation, monitoring, and operational maintenance.

  • Curate and correct code in Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
  • Evaluate AI-generated backend, frontend, API, and machine learning code against quality and performance expectations.
  • Build agents that identify error patterns and verify software solutions.
  • Design verification systems that automatically test solutions to software engineering tasks.
  • Assess software across architecture, development, debugging, production use, monitoring, and maintenance.
  • Write clear, structured explanations for your technical evaluations.

Requirements

This is a flexible, part-time contractor engagement.

  • Schedule: 20 or more hours per week.
  • Term: One month initially, with possible extensions based on performance and fit.
  • Language: Fluent English.
  • Experience: At least three years of software engineering experience.
  • Skills: Strong full-stack development with Python and JavaScript, including React and Node.js.
  • Skills: Experience deploying scalable, production-grade software with modern languages and tools.
  • Knowledge: Software architecture, design, development, debugging, and code review.
  • Skills: Python, JavaScript, Java, C++, Rust

Open to applicants in

  • United States

Preferred

  • Helpful background: Large language model training, software benchmarking, automated verification, agent development, or advanced AI systems.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

Job ID: cmw4vd5z7002u08l56wv5b29h

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer DevOps

Build AWS automation, CI/CD pipelines, and security controls for LLM evaluation work. This US-based remote contract offers 20+ hours per week and pays $25 per label.

DevOps
Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible
Per task · $25/label

Posted Nov 14, 2026

Junior Machine Learning Engineer

Complete coding-heavy AI training tasks involving machine learning models, Python, evaluation systems, and performance optimization. Work remotely for about 15 hours per week, with $60 to $120 per hour equivalent, paid per accepted task.

Machine Learning
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 12, 2026

Software Engineer, AI Coding Task Creator

Create realistic bugs, features, refactoring, and performance tasks that test AI coding ability. This part-time contractor role pays $50 to $100 per hour equivalent, paid per task that meets project specifications.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026

Game Developer (Godot Expert)

Work remotely on AI training projects involving Godot game development, gameplay systems, and technical reviews. Earn $70 to $130 per hour with flexible weekly hours over 1 to 3 months.

GodotGame Development
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $70–$130/hr

Posted Nov 11, 2026

Backend Software Engineer for AI Coding Tasks

Evaluate AI coding tasks using real repository code, technical rubrics, and clear written feedback. The role pays $50 to $100 per hour equivalent, paid per task that meets the project specifications, for about 15 hours per week.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026