Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer, LLM Code Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

11 countries

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

  • Create code datasets for training, benchmarking, and advancing large language models.
  • Curate code examples and build solutions in Python, JavaScript, ReactJS, C, C++, Java, Rust, and Go.
  • Evaluate and improve AI-generated code for efficiency, scalability, and reliability.
  • Work with researchers and cross-functional teams to improve AI coding solutions against industry benchmarks.
  • Build agents that verify code quality and identify patterns in errors.
  • Develop and test ideas about steps in the software engineering cycle to evaluate model capabilities.
  • Design verification methods that automatically check solutions to software engineering tasks.

Requirements

  • Flexible commitment of 20+ hours per week, with work available up to 40 hours per week.
  • The project is expected to last 1 month, with potential extensions based on performance and fit.
  • Professional fluency in English.
  • At least 3 years of software engineering experience.
  • Strong expertise building full-stack applications and deploying scalable, production-grade software.
  • Strong knowledge of software architecture, design, development, debugging, code quality, and code review assessment across Python, JavaScript, ReactJS, C, C++, Java, Rust, and Go.
  • Strong oral and written communication skills for clear, structured evaluation rationales.
  • This is a part-time contractor role without medical or paid leave.

Open to applicants in

  • Austria
  • Belgium
  • Canada
  • France
  • Germany
  • Liechtenstein
  • Luxembourg
  • Monaco
  • Netherlands
  • Switzerland
  • United States

Preferred

  • Experience with LLM evaluation or AI model training is helpful.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmrnie1d6001t04l5kwxz8q01

Keep exploring

Similar open roles

View all AI training jobs

Talent Automation Lead

Build and evolve an automation agent for talent operations through workflow automation, large language model integration, and fullstack development. This remote contractor role pays $57.69 to $76.92 per hour and requires 20+ hours weekly.

Workflow automationProcess improvementLLMsFullstack development
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $57.69–$76.92/hr

Posted Nov 21, 2026

Forward Deployed Engineer

Build production AI systems, data infrastructure, agent workflows, and evaluation tools as a Forward Deployed Engineer. Pay is $86.54 to $120.19 per hour, with 20+ hours per week.

PythonLLM SystemsML InfrastructureRAG/AI Automation
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $86.54–$120.19/hr

Posted Nov 20, 2026

Director of Infrastructure Engineering

Lead cloud infrastructure, reliability, security, and platform engineering for advanced AI products at $110.58 to $125 per hour. The role requires 20+ hours per week and strong AWS, GCP, Terraform, Kubernetes, and team leadership experience.

AWSGCPIaCCI/CDSecurity-first MindsetTeam Leadership
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $110.58–$125/hr

Posted Nov 20, 2026

Software Engineer, Financial Platform (English)

Build and maintain financial platform software across backend services, REST APIs, AWS infrastructure, and responsive interfaces. This contractor role pays $67.31 to $76.92 per hour and requires 20+ hours per week.

ReactNode.jsPostgreSQLAWS
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $67.31–$76.92/hr

Posted Nov 19, 2026

Software Engineer, Internal Platforms

Build internal platforms, backend services, APIs, and frontend tools as a contractor. This entry-level role pays $57.69 to $74.52 per hour and requires 20+ hours weekly.

ReactNode.jsPostgreSQLAWS
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $57.69–$74.52/hr

Posted Nov 19, 2026