Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Senior Python Engineer, LLM Evaluation to create and refine software engineering datasets for training and benchmarking large language models. You will work with code examples, precise solutions, corrections, and AI-generated programs, helping assess whether they are efficient, scalable, reliable, and aligned with industry performance expectations. The work is particularly focused on Python across backend services, data pipelines, and machine learning infrastructure, with additional coverage of JavaScript, ReactJS, C/C++, Java, Rust, and Go.

What you will do
Curate code examples and develop precise solutions for software engineering tasks.
Evaluate and improve AI-generated code for correctness, efficiency, scalability, and reliability.
Build Python agents and automated verification tools that identify error patterns and assess code quality.
Design mechanisms that automatically verify solutions to software engineering problems.
Evaluate model capabilities across prototyping, architecture design, API design, implementation, launch, experimentation, monitoring, and operational maintenance.
Collaborate with cross-functional teams to improve AI-driven coding solutions against performance benchmarks.

Required skills
At least three years of software engineering experience.
Deep Python expertise, including production-grade frameworks, tooling, and best practices.
Experience building full-stack applications and deploying scalable software.
Strong knowledge of software architecture, design, development, debugging, and code quality assessment.
Ability to produce clear, structured written and verbal evaluation rationales.
Working experience with one or more additional languages or ecosystems, including JavaScript, ReactJS, C/C++, Java, Rust, or Go.

Engagement details
This is a contractor engagement with a flexible commitment of 10 to 40 hours per week and an initial duration of one month. Potential extensions may be available based on performance and fit. The role is available to candidates based in the United States.

Helpful background
Experience working on advanced AI systems, large language model evaluation, software agents, automated verification, or production machine learning infrastructure can be especially relevant. Strong computer science foundations and experience with technically demanding software systems are also useful for this work.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vd0ni001e08l54z8p1z6y

Keep exploring

Similar open roles

View all AI training jobs

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer - LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026