Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

You will evaluate AI-generated code and full-stack software examples to help improve AI systems. Your reviews will focus on software engineering quality, correctness, architecture, and adherence to project guidelines.

You will provide clear, evidence-based explanations for your judgments and help maintain consistent review quality across repeated evaluation tasks.

  • Review source materials and AI-generated code against project guidelines.
  • Evaluate backend and frontend code, including full-stack applications.
  • Apply project rubrics and document evidence-based judgments.
  • Explain your decisions clearly in written evaluation rationales.
  • Maintain consistency and quality across review tasks.

Requirements

The listing does not provide a pay rate. The role is a part-time contractor engagement for candidates in the United States.

  • Schedule: 20 or more hours per week.
  • Experience: At least 3 years of software engineering experience.
  • Technical skills: Strong full-stack development experience with Python and JavaScript, including React and Node.js.
  • Engineering knowledge: Software architecture, design, development, debugging, deployment, scalability, and code quality review.
  • Communication: Excellent written and spoken English for clear, structured evaluation feedback.
  • AI training experience is not required.
  • Skills: Python, JavaScript, Java, C++, Rust

Open to applicants in

  • United States

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

Job ID: cmw4vcz32000s08l5y10rqd0o

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer DevOps

Build AWS automation, CI/CD pipelines, and security controls for LLM evaluation work. This US-based remote contract offers 20+ hours per week and pays $25 per label.

DevOps
Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible
Per task · $25/label

Posted Nov 14, 2026

Junior Machine Learning Engineer

Complete coding-heavy AI training tasks involving machine learning models, Python, evaluation systems, and performance optimization. Work remotely for about 15 hours per week, with $60 to $120 per hour equivalent, paid per accepted task.

Machine Learning
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 12, 2026

Software Engineer, AI Coding Task Creator

Create realistic bugs, features, refactoring, and performance tasks that test AI coding ability. This part-time contractor role pays $50 to $100 per hour equivalent, paid per task that meets project specifications.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026

Game Developer (Godot Expert)

Work remotely on AI training projects involving Godot game development, gameplay systems, and technical reviews. Earn $70 to $130 per hour with flexible weekly hours over 1 to 3 months.

GodotGame Development
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $70–$130/hr

Posted Nov 11, 2026

Backend Software Engineer for AI Coding Tasks

Evaluate AI coding tasks using real repository code, technical rubrics, and clear written feedback. The role pays $50 to $100 per hour equivalent, paid per task that meets the project specifications, for about 15 hours per week.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026