Skip to content
OpenTrain AIFor AI Companies

Senior Python Engineer, LLM Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting a Senior Python Engineer focused on evaluating software engineering code for large language model training and benchmarking. You will help create high-quality datasets by curating code examples, developing precise solutions, correcting implementations, and assessing AI-generated code for systems-level correctness, efficiency, scalability, and reliability. The role centers on backend, infrastructure, and performance-critical software across several major programming languages.

What you will do
Curate code examples and build or correct solutions in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS. Evaluate AI-generated code against standards for correctness, performance, scalability, reliability, and code quality. Build verification agents that identify error patterns and assess systems-level and infrastructure code. Evaluate model capabilities across prototyping, architecture design, API design, production implementation, launch, experimentation, monitoring, and operational maintenance. Design mechanisms that can automatically verify solutions to software engineering tasks. Collaborate with technical teams to improve AI-driven coding solutions against performance benchmarks.

Required skills
At least three years of software engineering experience. Strong systems programming, infrastructure, or backend development expertise, especially with Python, C/C++, Rust, or Go. Experience building and deploying scalable, production-grade software. Deep knowledge of software architecture, design, development, debugging, and code review. Strong written and oral communication skills for clear, structured evaluation rationales. Experience with advanced intelligent systems or AI-related software is helpful, while demonstrated engineering skill takes precedence over pedigree.

Engagement details
This is a contractor engagement for candidates based in the United States. The expected commitment is flexible, from 10 to 40 hours per week, with an initial duration of one month and potential extensions based on performance and fit.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vd0iu001c08l5ec0oumey

Keep exploring

Similar open roles

View all AI training jobs

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Python Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026