Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Senior Python Engineer, LLM Evaluation to create and assess coding datasets that support large language model training and benchmarking. You will work across full-stack software engineering contexts, refining AI-generated code and judging whether solutions meet standards for efficiency, scalability, reliability, and production quality. This role combines advanced software engineering judgment with hands-on AI training data development.

What You Will Do
You will curate code examples, construct precise solutions, and correct code across Python backend and machine learning workflows. You will develop and assess JavaScript solutions across React, Node.js, frontend, and API layers, with additional work in C/C++, Java, Rust, and Go. You will evaluate AI-generated code against software architecture, debugging, reliability, scalability, and industry performance standards. You will also build agents that verify code quality, identify recurring error patterns, and test solutions to software engineering tasks. The work includes assessing model capabilities across prototyping, architecture design, API design, production implementation, monitoring, and operational maintenance.

Required Skills
You should have at least three years of software engineering experience, strong full-stack development expertise with Python and JavaScript including React and Node.js, and experience deploying scalable, production-grade software using modern languages and tools. A deep understanding of software architecture, design, development, debugging, and code review is required, along with the ability to communicate structured evaluation rationales clearly in writing and conversation.

Helpful background
Experience building intelligent systems or working on advanced AI software is helpful. Familiarity with C/C++, Java, Rust, or Go supports the broader coding evaluation scope. Experience with automated verification, agents, or model benchmarking can help you assess solutions across the software development lifecycle.

Engagement Details
This is a flexible contractor engagement requiring 10 to 40 hours per week for an initial one-month term, with potential extensions based on performance and fit. The role is remote for candidates based in the United States.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vd0er001a08l5hbowqe7k

Keep exploring

Similar open roles

View all AI training jobs

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026