Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Senior Python Engineer focused on evaluating and improving software engineering data used to train and benchmark large language models. You will work with code in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS, with particular attention to systems-level programming, infrastructure, performance-critical applications, scalability, and reliability. This contractor role combines hands-on coding judgment with structured assessment of AI-generated solutions.

What you will do
You will curate code examples and create precise solutions for model-training datasets. You will correct and refine code across Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS. You will evaluate AI-generated code for correctness, efficiency, scalability, reliability, and performance. You will build agents that verify systems-level and infrastructure code, identify recurring error patterns, assess model capabilities across the software engineering lifecycle, and design verification mechanisms that can automatically validate solutions to software engineering tasks.

Required skills
Candidates should have at least three years of software engineering experience, strong systems programming, infrastructure, or backend development expertise, especially with Python, C/C++, Rust, or Go, and experience building and deploying scalable, production-grade software. A deep understanding of software architecture, design, development, debugging, and code-quality review is required, along with the ability to write and explain clear, structured evaluation rationales.

Engagement details
This is a flexible contractor engagement requiring 10 to 40 hours per week. The initial duration is one month, with potential extensions based on performance and fit. Candidates must be based in the United States.

Why OpenTrain
OpenTrain helps freelancers consolidate AI training opportunities across platforms and build a durable AI training portfolio. This role offers a focused way to apply production software engineering judgment to model evaluation, coding data creation, and automated verification work.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vd0a0001808l5d0dt2mtn

Keep exploring

Similar open roles

View all AI training jobs

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026