Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freelance career. We help candidates discover high-quality AI training, evaluation, and data work without scattering their track record across disconnected sites.

About this role
OpenTrain is recruiting for a Senior Python Engineer, LLM Code Evaluation to support AI training work focused on Software Engineering for LLM Evaluation. This role uses AI-generated code, curated programming examples, and verification solutions so AI systems can learn from structured human expertise, careful review, and clear written feedback. Prior AI training experience is not required unless stated elsewhere on this job page; the most important qualification is strong real-world knowledge of the subject area.

What you will do
- evaluate model outputs, apply project rubrics, and document evidence-based judgments
- Review source materials and model outputs against project guidelines
- Explain judgments clearly so the feedback can improve model behavior
- Maintain consistency and quality across repeated review tasks

Required skills
- Several years of software engineering experience (3 years or more)
- Strong expertise in Python with deep knowledge of frameworks, tooling, and best practices for building production-grade software.
- Experience building full-stack applications and deploying scalable software using modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
- Excellent oral and written communication skills for clear, structured evaluation rationales.

Helpful background
- We especially welcome graduates from top computer science programs such as Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, and comparable institutions - though exceptional experience and skill always take precedence over pedigree.

Schedule and pay
Flexible engagement requiring a minimum of 10 hours per week and allowing up to 40 hours per week.
Compensation is handled through the OpenTrain project budget fields shown on this job page.

Why work with OpenTrain
OpenTrain gives freelancers one place to find AI training work, build a unified AI training portfolio, and use that work history to qualify for more opportunities over time. For domain experts, language specialists, writers, engineers, and reviewers, AI training is a growing market where specialized judgment can become a flexible and repeatable source of income.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vdfuy000808jn8xqklabf

Keep exploring

Similar open roles

View all AI training jobs

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026