Skip to content
OpenTrain AIFor AI Companies

Senior Python Developer, AI Model Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

Worldwide

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

  • Support the improvement of large language models through coding, data generation, and evaluation work.
  • Design, develop, and maintain efficient Python code for AI training and evaluation workflows.
  • Run evaluations to benchmark model performance and analyze the results.
  • Evaluate and rank AI model responses for quality, relevance, accuracy, and alignment.
  • Create supervised fine-tuning datasets, model responses, code solutions, and evaluation rationales for specific tasks.
  • Create and refine responses for clarity, relevance, and technical accuracy.
  • Contribute to reinforcement learning from human feedback and reward-model refinement.
  • Design evaluation strategies, review code and documentation, and provide constructive technical feedback.
  • Work with researchers and annotators while exploring tools and methods that strengthen AI training processes.

Requirements

  • Compensation is not disclosed for this assignment.
  • Fully remote work open worldwide.
  • This is a contractor assignment lasting 1 month.
  • Commit to at least 20 hours per week and at least 4 hours per day, with 4 hours of overlap with Pacific Time. Available commitments are 20, 30, or 40 hours per week.
  • At least 3 years of strong Python programming experience, with familiarity with Python frameworks and libraries.
  • Knowledge of software development quality, formatting, architecture, and best practices.
  • Experience with unit, integration, and property-based testing in Python.
  • Understanding of multithreading and asynchronous programming.
  • Ability to refactor code safely without regressions and diagnose memory or concurrency issues.
  • Ability to write clear evaluation rationales and technically accurate responses.
  • Fluent conversational and written English.

Open worldwide

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmrnidyjc001f04l5473za1zj

Keep exploring

Similar open roles

View all AI training jobs

Talent Automation Lead

Build and evolve an automation agent for talent operations through workflow automation, large language model integration, and fullstack development. This remote contractor role pays $57.69 to $76.92 per hour and requires 20+ hours weekly.

Workflow automationProcess improvementLLMsFullstack development
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $57.69–$76.92/hr

Posted Nov 21, 2026

Forward Deployed Engineer

Build production AI systems, data infrastructure, agent workflows, and evaluation tools as a Forward Deployed Engineer. Pay is $86.54 to $120.19 per hour, with 20+ hours per week.

PythonLLM SystemsML InfrastructureRAG/AI Automation
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $86.54–$120.19/hr

Posted Nov 20, 2026

Director of Infrastructure Engineering

Lead cloud infrastructure, reliability, security, and platform engineering for advanced AI products at $110.58 to $125 per hour. The role requires 20+ hours per week and strong AWS, GCP, Terraform, Kubernetes, and team leadership experience.

AWSGCPIaCCI/CDSecurity-first MindsetTeam Leadership
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $110.58–$125/hr

Posted Nov 20, 2026

Software Engineer, Financial Platform (English)

Build and maintain financial platform software across backend services, REST APIs, AWS infrastructure, and responsive interfaces. This contractor role pays $67.31 to $76.92 per hour and requires 20+ hours per week.

ReactNode.jsPostgreSQLAWS
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $67.31–$76.92/hr

Posted Nov 19, 2026

Software Engineer, Internal Platforms

Build internal platforms, backend services, APIs, and frontend tools as a contractor. This entry-level role pays $57.69 to $74.52 per hour and requires 20+ hours weekly.

ReactNode.jsPostgreSQLAWS
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $57.69–$74.52/hr

Posted Nov 19, 2026