Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer, LLM Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

  • Curate code examples and create or correct solutions for large language model training and benchmarking datasets.
  • Review AI-generated code for efficiency, scalability, reliability, code quality, and alignment with performance benchmarks.
  • Build verification agents and automated checks that identify error patterns and validate software engineering solutions.
  • Evaluate AI capabilities across prototyping, architecture design, API design, production implementation, launch, experimentation, monitoring, and operational maintenance.
  • Work with cross-functional teams to improve AI coding solutions.

Requirements

  • Pay details are not provided for this role.
  • The role requires 20+ hours per week and is a flexible contractor engagement.
  • The initial project duration is 1 month, with possible extensions based on performance and fit.
  • Professional fluency in English is required.
  • The work requires software engineering knowledge, including full-stack application development, production deployment, software architecture, design, development, debugging, code review, and automated verification.
  • You should be able to work with Python, JavaScript, ReactJS, C/C++, Java, Rust, and Go.
  • Clear oral and written communication is needed to produce structured evaluation explanations.

Open to applicants in

  • United States

Preferred

  • Experience reasoning across the full software engineering lifecycle and designing automated verification mechanisms is helpful.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmw4vdfry000608jnksjq3m04

Keep exploring

Similar open roles

View all AI training jobs

Forward Deployed Engineer

Build production AI systems, data infrastructure, agent workflows, and evaluation tools as a Forward Deployed Engineer. Pay is $86.54 to $120.19 per hour, with 20+ hours per week.

PythonLLM SystemsML InfrastructureRAG/AI Automation
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $86.54–$120.19/hr

Posted Nov 20, 2026

GPU Programming Software Engineer

Build and optimize GPU software for LLM training tasks with CUDA, WebGPU, or GLSL, plus C++ host-side integrations. Pay is $50 to $120 per hour equivalent, paid per task that meets project specifications.

CUDAWebGPUGLSLC++
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$120/hr equivalent

Posted Nov 20, 2026

CUDA Engineering Expert

Work remotely as a CUDA Engineering Expert profiling GPU kernels, optimizing C++ and CUDA code, and building GLSL and WebGPU shader workflows. The role pays $60 to $120 per hour and is open to candidates in 52 countries.

CUDAC++GLSLWebGPU
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $60–$120/hr

Posted Nov 20, 2026

Director of Infrastructure Engineering

Lead cloud infrastructure, reliability, security, and platform engineering for advanced AI products at $110.58 to $125 per hour. The role requires 20+ hours per week and strong AWS, GCP, Terraform, Kubernetes, and team leadership experience.

AWSGCPIaCCI/CDSecurity-first MindsetTeam Leadership
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $110.58–$125/hr

Posted Nov 20, 2026

AI/ML Engineer, Model and Pipeline Engineering

Design and improve machine learning models, data pipelines, and production systems as a remote, part-time contractor. The role pays $50-$100 per hour and requires strong Python, ETL, and model evaluation skills.

Machine LearningPythonETL
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $50–$100/hr

Posted Nov 19, 2026