Skip to content
OpenTrain AIFor AI Companies

LLM Code Evaluation Software Engineer

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

11 countries

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for an LLM Code Evaluation Software Engineer to help create datasets for training, benchmarking, and advancing large language models. In this contractor role, you will work closely with researchers to curate code examples, provide precise solutions, and correct code across multiple programming languages. You will evaluate and refine AI-generated code, build verification agents, and collaborate with cross-functional teams to drive high-quality AI coding solutions.

What you will do
- Curate code examples and build solutions in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
- Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability.
- Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry benchmarks.
- Build agents that verify code quality and identify error patterns.
- Hypothesize on steps in the software engineering cycle and evaluate model capabilities on them.
- Design verification mechanisms that automatically verify solutions to software engineering tasks.

Required skills
- Several years of software engineering experience (3 years or more).
- Strong expertise in building full-stack applications and deploying scalable, production-grade software.
- Deep understanding of software architecture, design, development, debugging, and code quality or review assessment.
- Excellent oral and written communication skills for clear, structured evaluation rationales.

Helpful background
- Experience with LLM evaluation or AI model training is a plus.

Engagement details
- Commitment: flexible, minimum 10 hours per week, up to 40 hours per week.
- Duration: 1 month with potential extensions based on performance and fit.
- Location: candidates must be based in the US, Canada, or Western European countries (Austria, Belgium, France, Germany, and others).
- Contractor type: no medical or paid leave.

Requirements

  • Languages: English

Open to applicants in

  • Austria
  • Belgium
  • Canada
  • France
  • Germany
  • Liechtenstein
  • Luxembourg
  • Monaco
  • Netherlands
  • Switzerland
  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmrnie1d6001t04l5kwxz8q01

Keep exploring

Similar open roles

View all AI training jobs

Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Flexible hours

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026