Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

You will create and refine code datasets used to train and benchmark large language models. The work focuses on Python across backend services, data pipelines, and machine learning infrastructure, with additional code in JavaScript, ReactJS, C/C++, Java, Rust, and Go.

You will review AI-generated code and explain whether it meets standards for efficiency, scalability, reliability, and software engineering performance. You will also build Python agents and automated checks that find error patterns and verify software solutions.

  • Curate code examples and create precise solutions for AI model training.
  • Correct implementations and improve AI-generated code.
  • Assess software across prototyping, architecture, API design, production implementation, experimentation, monitoring, and operational maintenance.
  • Collaborate with cross-functional teams to improve AI coding solutions against industry benchmarks.

Requirements

This is a contractor engagement planned for one month, with possible extensions based on performance and fit. No pay rate is provided in the listing.

  • Time commitment: 20 or more hours per week.
  • Experience: At least three years of software engineering experience.
  • Technical skills: Strong Python expertise, including production frameworks, tools, and development practices.
  • Software background: Experience building full-stack applications and deploying scalable software with modern languages and tools.
  • Knowledge: Software architecture, design, development, debugging, and code-quality assessment.
  • Communication: Ability to clearly explain technical evaluation decisions in writing and conversation.
  • Language: Fluent in English.
  • Skills: Python, JavaScript, Java, C++, Rust

Open to applicants in

  • United States

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

Job ID: cmw4vd137001i08l5cqwy5nx5

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer DevOps

Build AWS automation, CI/CD pipelines, and security controls for LLM evaluation work. This US-based remote contract offers 20+ hours per week and pays $25 per label.

DevOps
Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible
Per task · $25/label

Posted Nov 14, 2026

Junior Machine Learning Engineer

Complete coding-heavy AI training tasks involving machine learning models, Python, evaluation systems, and performance optimization. Work remotely for about 15 hours per week, with $60 to $120 per hour equivalent, paid per accepted task.

Machine Learning
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 12, 2026

Software Engineer, AI Coding Task Creator

Create realistic bugs, features, refactoring, and performance tasks that test AI coding ability. This part-time contractor role pays $50 to $100 per hour equivalent, paid per task that meets project specifications.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026

Game Developer (Godot Expert)

Work remotely on AI training projects involving Godot game development, gameplay systems, and technical reviews. Earn $70 to $130 per hour with flexible weekly hours over 1 to 3 months.

GodotGame Development
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $70–$130/hr

Posted Nov 11, 2026

Backend Software Engineer for AI Coding Tasks

Evaluate AI coding tasks using real repository code, technical rubrics, and clear written feedback. The role pays $50 to $100 per hour equivalent, paid per task that meets the project specifications, for about 15 hours per week.

Python3JAVARustAlgorithmsBasics C++Typescript
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$100/hr equivalent

Posted Nov 11, 2026