Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain. OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role. OpenTrain is recruiting for a Senior Python Engineer focused on evaluating and improving software engineering work used to train and benchmark large language models. You will work with code examples, programming solutions, corrections, and AI-generated code, applying engineering judgment to assess efficiency, scalability, reliability, and performance across backend services, data pipelines, machine learning infrastructure, and broader software development workflows.

What you will do. Curate code examples and create precise programming solutions for model-training datasets. Evaluate and refine AI-generated code for correctness, efficiency, scalability, and reliability. Build Python agents and automated verification tools that identify error patterns and validate software solutions. Assess model capabilities across prototyping, architecture design, API design, implementation, launch, experimentation, monitoring, and operational maintenance. Design verification mechanisms for software engineering tasks and compare coding solutions against performance benchmarks. Contribute code in Python, JavaScript including ReactJS, C/C++, Java, Rust, and Go.

Required skills. At least three years of software engineering experience. Strong Python expertise, including production frameworks, tooling, and best practices. Experience building full-stack applications and deploying scalable software. Deep knowledge of software architecture, development, debugging, and code quality review. Ability to produce clear, structured rationales for technical evaluations. Familiarity with backend services, data pipelines, or machine learning infrastructure.

Helpful background. Experience building production systems in a high-scale engineering environment and a strong computer science foundation are helpful. Exceptional practical engineering skill is valued alongside formal education.

Why work with OpenTrain. OpenTrain helps freelancers discover specialized AI training opportunities, manage work from multiple platforms, and build a durable portfolio that reflects their technical expertise. This role offers the opportunity to apply software engineering judgment to meaningful model evaluation and coding-quality projects.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vczw0001408l56g3ii727

Keep exploring

Similar open roles

View all AI training jobs

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026