Skip to content
OpenTrain AIFor AI Companies

Data Engineering & Data Science AI Evaluation Engineer

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

10 countries

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Data Engineering and Data Science AI Evaluation Engineer to design and validate data pipelines and evaluation tasks used to benchmark advanced AI systems. This is a hands-on contractor role working with production-like datasets, Python code, and real-world data workflows to help measure AI model performance.

What you will do
- Work with structured and unstructured datasets to support SWE Bench-style evaluation tasks
- Design, build, and validate data pipelines used in benchmarking and evaluation workflows
- Perform data processing, analysis, feature preparation, and validation for data science use cases
- Write, run, and modify Python code to process data and support experiments locally
- Evaluate data quality, transformations, and outputs for correctness and reproducibility
- Create clean, well-documented, and reusable data workflows suitable for benchmarking
- Participate in code reviews to ensure high standards of code quality and maintainability
- Collaborate with researchers and engineers to design challenging, real-world data engineering and data science tasks for AI systems

Required skills
- Minimum 3+ years of overall experience as a Data Engineer, Data Scientist, or Software Engineer (data-focused)
- Strong proficiency in Python for data engineering and data science workflows
- Demonstrable experience with data processing, analysis, and model-related workflows
- Solid understanding of machine learning and data science fundamentals
- Experience working with structured and unstructured data
- Ability to understand, navigate, and modify complex, real-world codebases
- Experience writing readable, reusable, maintainable, and well-documented code
- Strong problem-solving skills, including experience with algorithmic or data-intensive problems
- Excellent spoken and written English communication skills

Helpful background
- Experience with SWE Bench or similar benchmark-driven evaluation projects
- Background in designing AI model evaluation tasks

Schedule and commitment
- At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST
- 3-month contract (adjustable based on engagement)

Requirements

  • Languages: English

Open to applicants in

  • Bangladesh
  • Brazil
  • Egypt
  • Ghana
  • India
  • Kenya
  • Mexico
  • Nigeria
  • Pakistan
  • Türkiye

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmrnie2xl002104l53kww0zc3

Keep exploring

Similar open roles

View all AI training jobs

AI Data Engineer

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonSQLAI/MLSparkAWS
Code
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $48.08–$72.12/hr

Posted Nov 18, 2026

Senior Backend Engineer for AI Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Backend Engineer for AI Code Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Energy Operations AI Evaluation Engineer

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $85/hr

Posted Nov 5, 2026

Senior Data Analyst for AI Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Personal Identifiable InformationQuality AssuranceAttention to DetailData AnalysisBusiness Data Sets
Text
Remote · United States
English
Part-time · Flexible
Hourly · $50–$60/hr

Posted Oct 8, 2026