Skip to content
OpenTrain AIFor AI Companies

Software Engineer, LLM Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a contractor Software Engineer, LLM Code Evaluation role focused on creating training and benchmarking datasets for large language models. You will evaluate and refine AI-generated code, produce precise solutions and corrections, and help assess software engineering capabilities across the development lifecycle. The work combines production software expertise with structured review of code quality, reliability, scalability, and error patterns.

What you will do
Curate code examples and develop or correct solutions in Python, JavaScript, ReactJS, C/C++, Java, Rust, and Go. Review AI-generated code for efficiency, scalability, reliability, and alignment with industry performance benchmarks. Build verification agents and mechanisms that identify error patterns and automatically validate software engineering solutions. Evaluate model capabilities across prototyping, architecture design, API design, production implementation, launch, experimentation, monitoring, and operational maintenance. Collaborate with cross-functional teams to improve AI-driven coding solutions.

Required skills
At least three years of software engineering experience, with strong full-stack application development and production deployment expertise. Deep knowledge of software architecture, design, development, debugging, and code review assessment is required, along with working ability in multiple listed programming languages. Strong oral and written communication skills are needed to produce clear, structured evaluation rationales. Experience designing automated verification mechanisms and reasoning across the full software engineering lifecycle is helpful.

Work arrangement
This is a flexible contractor engagement requiring at least 10 hours per week and allowing up to 40 hours per week. The initial duration is one month, with potential extensions based on performance and fit. Candidates must be based in the United States, Canada, or the explicitly listed Western European countries.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vdfry000608jnksjq3m04

Keep exploring

Similar open roles

View all AI training jobs

Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Flexible hours

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026