Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

You will help create and improve software engineering datasets used to train and evaluate large language models. The work centers on Python, with additional coverage of JavaScript, ReactJS, C/C++, Java, Rust, and Go.

  • Curate code examples and create precise solutions for software engineering tasks.
  • Review AI-generated code for correctness, efficiency, scalability, and reliability.
  • Build Python agents and automated tools that find error patterns and assess code quality.
  • Design automated checks that verify solutions to software engineering problems.
  • Evaluate model performance across architecture, API design, implementation, launch, monitoring, and maintenance.
  • Work with other teams to improve AI coding solutions against performance benchmarks.

Requirements

This is a contractor, part-time engagement for candidates based in the United States. The initial engagement lasts one month, with possible extensions based on performance and fit.

  • Schedule: Flexible commitment of 10 to 40 hours per week.
  • Experience: At least three years of software engineering experience.
  • Required: Deep Python knowledge, including production frameworks, tools, and best practices.
  • Required: Experience building full-stack applications and deploying scalable software.
  • Required: Strong skills in software architecture, design, development, debugging, and code quality review.
  • Required: Clear, structured written and spoken explanations of evaluation decisions.
  • Required: Experience with JavaScript, ReactJS, C/C++, Java, Rust, or Go, in addition to Python.
  • Languages: English
  • Skills: Python, JavaScript, Java, C++, Rust

Open to applicants in

  • United States

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

Job ID: cmw4vd0ni001e08l54z8p1z6y

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer DevOps

Build AWS automation, CI/CD pipelines, and security controls for LLM evaluation work. This US-based remote contract offers 20+ hours per week and pays $25 per label.

DevOps
Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible
Per task · $25/label

Posted Nov 14, 2026

Junior Machine Learning Engineer

Complete coding-heavy AI training tasks involving machine learning models, Python, evaluation systems, and performance optimization. Work remotely for about 15 hours per week, with $60 to $120 per hour equivalent, paid per accepted task.

Machine Learning
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 12, 2026

Software Engineer, AI Coding Task Creator

Create realistic bugs, features, refactoring, and performance tasks that test AI coding ability. This part-time contractor role pays $50 to $100 per hour equivalent, paid per task that meets project specifications.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026

Game Developer (Godot Expert)

Work remotely on AI training projects involving Godot game development, gameplay systems, and technical reviews. Earn $70 to $130 per hour with flexible weekly hours over 1 to 3 months.

GodotGame Development
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $70–$130/hr

Posted Nov 11, 2026

Backend Software Engineer for AI Coding Tasks

Evaluate AI coding tasks using real repository code, technical rubrics, and clear written feedback. The role pays $50 to $100 per hour equivalent, paid per task that meets the project specifications, for about 15 hours per week.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026