Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer, LLM Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

OpenTrain is recruiting senior software engineers to evaluate AI-generated code and create training and benchmarking datasets for large language models. This contractor role combines hands-on full-stack engineering with structured model evaluation. Engineers will curate examples, produce precise solutions, correct implementation errors, and assess software across development and production workflows. The work covers Python for backend and machine learning workflows, JavaScript, React, and Node.js for frontend and API layers, and additional systems work in C/C++, Java, Rust, and Go.

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
As a Senior Software Engineer focused on LLM evaluation, you will help improve AI-driven coding systems through expert code creation, correction, verification, and evaluation. You will examine whether generated solutions are efficient, scalable, reliable, and aligned with industry performance benchmarks while contributing to datasets used to train and assess large language models.

What you will do
Curate code examples and build accurate solutions across backend, frontend, API, and machine learning contexts. Review and refine AI-generated code for correctness, maintainability, scalability, and reliability. Evaluate model capabilities across prototyping, architecture design, API design, production implementation, experimentation, monitoring, and operational maintenance. Build agents that verify code quality and identify recurring error patterns in full-stack applications. Design automated verification mechanisms for software engineering tasks. Collaborate with cross-functional teams on AI-driven coding solutions and performance benchmarks.

Required skills
At least three years of software engineering experience. Strong full-stack development expertise in Python and JavaScript, including React and Node.js. Experience deploying scalable, production-grade software with modern languages and tools. Deep knowledge of software architecture, design, development, debugging, and code-quality assessment. Clear oral and written communication for structured evaluation rationales.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw4vcyu6000o08l5z01gegq2

Keep exploring

Similar open roles

View all AI training jobs

Senior Software Engineer, LLM Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer - LLM Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

Evaluate and improve AI-generated code, create coding datasets, and build tools that verify software solutions. This flexible contract role is open to senior software engineers in the US, Canada, and Western Europe.

PythonJavaScriptJavaC++Rust
Coding & Software
Code
Remote · Austria, Belgium, Canada +8 more
English
Part-time · Flexible

Posted Jul 16, 2026

Senior Software Engineer C++ LLM Evaluation

Evaluate C++ code, repositories, and LLM performance on real software tasks. This remote contract offers flexible 20, 30, or 40-hour options across 9 countries.

C++
Coding & Software
Code
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible

Posted Jul 17, 2026