Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

You will create and review code used to train and test large language models. The work focuses on systems programming, infrastructure, backend development, and production-level software engineering.

You will also help measure how well AI systems handle software architecture, implementation, deployment, monitoring, and ongoing operations.

  • Curate code examples and develop accurate solutions for model training projects.
  • Correct and evaluate code in Python, C/C++, Rust, Go, Java, JavaScript, and ReactJS.
  • Review AI-generated code for correctness, performance, scalability, and reliability.
  • Build agents that check infrastructure code quality and identify repeated error patterns.
  • Design ways to automatically verify solutions to software engineering tasks.
  • Provide clear, structured reasons for your technical evaluations.

Requirements

This is a flexible contractor engagement for candidates based in the United States. The expected engagement is one month, with possible extensions based on performance and fit.

  • Compensation: Not provided.
  • Schedule: 20+ hours per week.
  • Experience: At least three years of software engineering experience.
  • Technical background: Strong systems programming, infrastructure, or backend development skills, especially with Python, C/C++, Rust, or Go.
  • Production experience: Experience building and deploying scalable, production-grade software.
  • Core knowledge: Software architecture, design, development, debugging, and code review.
  • Languages: English
  • Skills: Python, JavaScript, Java, C++, Rust

Open to applicants in

  • United States

Preferred

  • Helpful background: Experience building production systems at a high-scale engineering organization and a strong computer science foundation. Practical technical skill is considered alongside formal education.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

Job ID: cmw4vcyyr000q08l5i5fup2bx

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer DevOps

Build AWS automation, CI/CD pipelines, and security controls for LLM evaluation work. This US-based remote contract offers 20+ hours per week and pays $25 per label.

DevOps
Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible
Per task · $25/label

Posted Nov 14, 2026

Junior Machine Learning Engineer

Complete coding-heavy AI training tasks involving machine learning models, Python, evaluation systems, and performance optimization. Work remotely for about 15 hours per week, with $60 to $120 per hour equivalent, paid per accepted task.

Machine Learning
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 12, 2026

Software Engineer, AI Coding Task Creator

Create realistic bugs, features, refactoring, and performance tasks that test AI coding ability. This part-time contractor role pays $50 to $100 per hour equivalent, paid per task that meets project specifications.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026

Game Developer (Godot Expert)

Work remotely on AI training projects involving Godot game development, gameplay systems, and technical reviews. Earn $70 to $130 per hour with flexible weekly hours over 1 to 3 months.

GodotGame Development
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $70–$130/hr

Posted Nov 11, 2026

Backend Software Engineer for AI Coding Tasks

Evaluate AI coding tasks using real repository code, technical rubrics, and clear written feedback. The role pays $50 to $100 per hour equivalent, paid per task that meets the project specifications, for about 15 hours per week.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026