Skip to content
OpenTrain AIFor AI Companies

Software Engineer, LLM Evaluation and Repository Validation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

Worldwide

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

  • Analyze and triage issues across widely used open-source libraries.
  • Configure repositories and development environments, including Docker-based setups.
  • Review unit-test coverage and assess test quality.
  • Modify and run codebases locally to evaluate LLM performance on bug-fixing tasks.
  • Help identify repositories and issues that create meaningful challenges for language models.
  • Help coordinate junior engineers on project work when needed.

Requirements

  • Pay is not specified in the supplied role details.
  • This is a part-time contractor role requiring 20+ hours per week.
  • The role is open worldwide and requires professional fluency in English.
  • Have strong programming experience in at least 1 of Python, JavaScript, Java, Go, Rust, C, C++, C#, or Ruby.
  • Be proficient with Git, Docker, and basic software pipeline setup.
  • Be able to understand and navigate complex codebases and run, modify, and test real-world projects locally.
  • Experience contributing to or evaluating open-source projects is useful, especially work with well-maintained public repositories.
  • Previous work in LLM research or evaluation, or experience building and testing developer tools or automation agents, is relevant.

Open worldwide

Preferred

  • Familiarity with widely used public repositories, including repositories with 500 or more stars, is helpful.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmrnidzfy001j04l5mxkpgan7

Keep exploring

Similar open roles

View all AI training jobs

Senior Data Engineer Java Snowflake (English)

Build Java 17+ backend services, Snowflake pipelines, and secure transaction systems for banking, financial services, and insurance. This worldwide contract role requires 20+ hours weekly and English fluency.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 20, 2026

Forward Deployed Engineer

Build production AI systems, data infrastructure, agent workflows, and evaluation tools as a Forward Deployed Engineer. Pay is $86.54 to $120.19 per hour, with 20+ hours per week.

PythonLLM SystemsML InfrastructureRAG/AI Automation
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $86.54–$120.19/hr

Posted Nov 20, 2026

GPU Programming Software Engineer

Build and optimize GPU software for LLM training tasks with CUDA, WebGPU, or GLSL, plus C++ host-side integrations. Pay is $50 to $120 per hour equivalent, paid per task that meets project specifications.

CUDAWebGPUGLSLC++
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $50–$120/hr equivalent

Posted Nov 20, 2026

CUDA Engineering Expert

Work remotely as a CUDA Engineering Expert profiling GPU kernels, optimizing C++ and CUDA code, and building GLSL and WebGPU shader workflows. The role pays $60 to $120 per hour and is open to candidates in 52 countries.

CUDAC++GLSLWebGPU
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $60–$120/hr

Posted Nov 20, 2026

Director of Infrastructure Engineering

Lead cloud infrastructure, reliability, security, and platform engineering for advanced AI products at $110.58 to $125 per hour. The role requires 20+ hours per week and strong AWS, GCP, Terraform, Kubernetes, and team leadership experience.

AWSGCPIaCCI/CDSecurity-first MindsetTeam Leadership
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $110.58–$125/hr

Posted Nov 20, 2026