Skip to content
OpenTrain AIFor AI Companies

Member Technical Staff Coding Agent Research Evaluation

Apply now

Job details

Pay

$8–$9 USD/hr

Engagement

Contract, part-time

Location

Remote

38 countries

Posted

Nov 17, 2026

OpenTrain on Trustpilot

The work

  • Design evaluation frameworks for coding agents, including benchmark specifications, scoring methods, rubrics, and quality standards.
  • Lead research that measures coding model performance and studies model behavior and failure modes.
  • Develop datasets and golden examples for coding agent evaluation.
  • Turn evaluation findings into improvements for AI model training and assessment.
  • Build tools and infrastructure for experiments, data generation, review workflows, and evaluation pipelines.
  • Establish repeatable assessment practices for coding agents.
  • Communicate findings through technical reports, benchmark studies, and research initiatives.

Requirements

  • Language: Professional fluency in English.
  • Technical skills: Strong software engineering experience with Python, C++, or a comparable programming language, plus strong analytical, automation, and technical communication skills.
  • Relevant experience: Designing, reviewing, or validating technical assessments, benchmarks, coding tasks, or evaluation methods.
  • Skills: Coding Agent Evaluation & Benchmark Design, Software Engineering & Python, LLM & Agentic Systems, Model Failure Analysis & Experimentation

Open to applicants in

  • Algeria
  • Argentina
  • Bahrain
  • Bangladesh
  • Brazil
  • Chile
  • Colombia
  • Egypt
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Saudi Arabia
  • South Africa
  • Spain
  • Sri Lanka
  • Taiwan
  • Thailand
  • Tunisia
  • Uzbekistan
  • Vietnam

Preferred

  • Helpful background: Frontier AI systems, agentic workflows, tool use, post-training methods, machine learning benchmarks, large-scale datasets, publications, open-source contributions, or technical leadership in AI, machine learning, or software engineering.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form. It asks for your resume again, your LinkedIn profile, your phone number, your location and answers to 2 screening questions.
  3. Take a short AI interview.

OpenTrain on Trustpilot

Job ID: cmwkasqoe00bf08l6kd6muarp

Keep exploring

Similar open roles

View all AI training jobs

Director of Engineering, Internal Platforms

Lead the architecture and development of internal platforms supporting AI, data, financial, and operational workflows. This part-time contractor role pays $216.35 to $384.62 per hour and requires fluent English plus senior engineering experience.

Platform Engineering & System ArchitectureAI Engineering & Agentic SystemsQuality Engineering & Test AutomationTechnical Leadership & Engineering Execution
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $216.35–$384.62/hr

Posted Nov 17, 2026

Strategic Project Lead, AI Coding And Evaluations

Lead coding data pipeline operations and evaluate AI model outputs using clear rubrics, technical judgment, and written feedback. This remote contractor role pays $80 to $90 per hour and is open across multiple countries.

Technical Project & Pipeline ManagementSoftware Engineering & Technical FluencyWorkflow Automation & Operational ExcellenceStakeholder Management & Quality Assurance
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $80–$90/hr

Posted Nov 17, 2026

Member of Technical Staff, Robotics & Embodied AI Research

Work remotely on robotics and embodied AI research, including robot learning, simulation, datasets, and physical policy evaluation. This part-time contract role pays $20 to $50 per hour and requires strong research and engineering skills.

Robot Learning & Embodied AIRobotics Simulation & Sim-to-Real TransferPython & Robotics Research EngineeringRobotics Data & Evaluation Design
Coding & Software
Video
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $20–$50/hr

Posted Nov 17, 2026

Senior Forward Deployed Engineer, U.S. Government

Build and deploy agentic AI systems for mission-critical U.S. Government environments at $40 to $60 per hour. This contractor role is open to candidates in listed countries and requires advanced Python and production engineering experience.

Agentic AI & LLM Systems EngineeringPython & Production Software EngineeringML Infrastructure & Model EvaluationTechnical Leadership & Forward Deployment
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $40–$60/hr

Posted Nov 17, 2026

AI/ML Engineer, Internal Platforms

Build AI agents, Python backend services, APIs, and production systems in a remote contractor role focused on AI Agent Development. The role pays $160 to $300 per hour and is open across many countries.

PythonLLMsAWSLangChainFastAPI
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $160–$300/hr

Posted Nov 17, 2026