Skip to content
OpenTrain AIFor AI Companies

Senior Software Engineer, LLM Evaluation, Repo Validation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

9 countries

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

  • Support LLM evaluation and training datasets for realistic software engineering problems.
  • Analyze and triage GitHub issues across open-source libraries.
  • Set up repositories with Docker and development environment automation.
  • Evaluate unit test coverage and quality.
  • Run and modify codebases locally to assess model performance on bug-fixing tasks.
  • Collaborate with researchers on repository and issue selection.
  • Support junior engineers on collaborative project work when needed.

Requirements

  • This is a part-time contract role requiring 20+ hours per week.
  • Professional fluency in English is required.
  • At least 3 years of overall engineering experience.
  • Strong Python experience.
  • Practical skill with Git, Docker, and software pipeline setup.
  • Comfort navigating complex codebases and testing real-world projects locally.

Open to applicants in

  • Bangladesh
  • Egypt
  • Ghana
  • India
  • Kenya
  • Mexico
  • Nigeria
  • Pakistan
  • Türkiye

Preferred

  • Experience contributing to or evaluating open-source projects is helpful.
  • Prior LLM research or evaluation experience is helpful.
  • Experience building or testing developer tools or automation agents is helpful.
  • Familiarity with high-quality public GitHub repositories is helpful.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmrnidzzm001n04l5sa5c1hx4

Keep exploring

Similar open roles

View all AI training jobs

Talent Automation Lead

Build and evolve an automation agent for talent operations through workflow automation, large language model integration, and fullstack development. This remote contractor role pays $57.69 to $76.92 per hour and requires 20+ hours weekly.

Workflow automationProcess improvementLLMsFullstack development
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $57.69–$76.92/hr

Posted Nov 21, 2026

Forward Deployed Engineer

Build production AI systems, data infrastructure, agent workflows, and evaluation tools as a Forward Deployed Engineer. Pay is $86.54 to $120.19 per hour, with 20+ hours per week.

PythonLLM SystemsML InfrastructureRAG/AI Automation
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $86.54–$120.19/hr

Posted Nov 20, 2026

Director of Infrastructure Engineering

Lead cloud infrastructure, reliability, security, and platform engineering for advanced AI products at $110.58 to $125 per hour. The role requires 20+ hours per week and strong AWS, GCP, Terraform, Kubernetes, and team leadership experience.

AWSGCPIaCCI/CDSecurity-first MindsetTeam Leadership
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $110.58–$125/hr

Posted Nov 20, 2026

Software Engineer, Financial Platform (English)

Build and maintain financial platform software across backend services, REST APIs, AWS infrastructure, and responsive interfaces. This contractor role pays $67.31 to $76.92 per hour and requires 20+ hours per week.

ReactNode.jsPostgreSQLAWS
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $67.31–$76.92/hr

Posted Nov 19, 2026

Software Engineer, Internal Platforms

Build internal platforms, backend services, APIs, and frontend tools as a contractor. This entry-level role pays $57.69 to $74.52 per hour and requires 20+ hours weekly.

ReactNode.jsPostgreSQLAWS
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $57.69–$74.52/hr

Posted Nov 19, 2026