Skip to content
OpenTrain AIFor AI Companies

Data Engineering & Data Science AI Evaluation Engineer

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

10 countries

Posted

Jul 16, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Data Engineering and Data Science AI Evaluation Engineer to design and validate data pipelines and evaluation tasks used to benchmark advanced AI systems. This is a hands-on contractor role working with production-like datasets, Python code, and real-world data workflows to help measure AI model performance.

What you will do
- Work with structured and unstructured datasets to support SWE Bench-style evaluation tasks
- Design, build, and validate data pipelines used in benchmarking and evaluation workflows
- Perform data processing, analysis, feature preparation, and validation for data science use cases
- Write, run, and modify Python code to process data and support experiments locally
- Evaluate data quality, transformations, and outputs for correctness and reproducibility
- Create clean, well-documented, and reusable data workflows suitable for benchmarking
- Participate in code reviews to ensure high standards of code quality and maintainability
- Collaborate with researchers and engineers to design challenging, real-world data engineering and data science tasks for AI systems

Required skills
- Minimum 3+ years of overall experience as a Data Engineer, Data Scientist, or Software Engineer (data-focused)
- Strong proficiency in Python for data engineering and data science workflows
- Demonstrable experience with data processing, analysis, and model-related workflows
- Solid understanding of machine learning and data science fundamentals
- Experience working with structured and unstructured data
- Ability to understand, navigate, and modify complex, real-world codebases
- Experience writing readable, reusable, maintainable, and well-documented code
- Strong problem-solving skills, including experience with algorithmic or data-intensive problems
- Excellent spoken and written English communication skills

Helpful background
- Experience with SWE Bench or similar benchmark-driven evaluation projects
- Background in designing AI model evaluation tasks

Schedule and commitment
- At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST
- 3-month contract (adjustable based on engagement)

Requirements

  • Languages: English

Open to applicants in

  • Bangladesh
  • Brazil
  • Egypt
  • Ghana
  • India
  • Kenya
  • Mexico
  • Nigeria
  • Pakistan
  • Türkiye

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmrnie2xl002104l53kww0zc3

Keep exploring

Similar open roles

View all AI training jobs

AI Data Engineer

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonSQLAI/MLSparkAWS
Code
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $48.08–$72.12/hr

Posted Nov 18, 2026

AI Data Scientist

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Data scienceEnglishMachine learningModel evaluationNumpyPython
Text
Remote · Germany, India, United States
English
Part-time · Flexible
Hourly · $60–$100/hr

Posted Jul 8, 2026

Senior Backend Engineer for AI Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Energy Operations AI Evaluation Engineer

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $85/hr

Posted Nov 5, 2026

Senior Data Analyst for AI Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Personal Identifiable InformationQuality AssuranceAttention to DetailData AnalysisBusiness Data Sets
Text
Remote · United States
English
Part-time · Flexible
Hourly · $50–$60/hr

Posted Oct 8, 2026