Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer, LLM Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Senior Software Engineer, LLM Code Evaluation role focused on creating training and benchmarking datasets for large language models. You will curate and correct code, provide precise solutions, evaluate AI-generated implementations, and help improve coding systems for efficiency, scalability, correctness, and reliability. The work centers on systems programming, infrastructure, backend development, and production-level software engineering practices.

What you will do
You will curate code examples and develop accurate solutions for model training initiatives. You will correct and evaluate code in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS. You will review AI-generated code for systems-level correctness, performance, scalability, and reliability, build agents that verify infrastructure code quality and identify recurring error patterns, and assess model capabilities across architecture, API design, implementation, launch, monitoring, and operational maintenance. You will also design mechanisms that automatically verify solutions to software engineering tasks.

Required skills
Applicants should have at least three years of software engineering experience and strong systems programming, infrastructure, or backend development expertise, especially with Python, C/C++, Rust, or Go. Experience building and deploying scalable, production-grade software is required. You should have deep knowledge of software architecture, design, development, debugging, and code review, along with the ability to provide clear, structured rationales for technical evaluations.

Helpful background
Experience building production systems at a high-scale engineering organization and a strong computer science foundation are valuable. Exceptional practical experience and technical skill are considered alongside formal education.

Engagement details
This is a flexible contractor engagement for candidates based in the United States. The engagement is expected to last one month, with potential extensions based on performance and fit.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vcyyr000q08l5i5fup2bx

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer - LLM Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Evaluation

OpenTrain is recruiting senior software engineers to evaluate AI-generated code and create training and benchmarking datasets for large language models. This contractor role combines hands-on full-stack engineering with…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

Evaluate and improve AI-generated code, create coding datasets, and build tools that verify software solutions. This flexible contract role is open to senior software engineers in the US, Canada, and Western Europe.

PythonJavaScriptJavaC++Rust
Coding & Software
Code
Remote · Austria, Belgium, Canada +8 more
English
Part-time · Flexible

Posted Jul 16, 2026