Data Scientist (English) AI Model Evaluation

You will help evaluate and improve AI systems by reviewing data science content. Your work will cover analytical reasoning, code, model outputs, prompts, and written explanations.

You will judge whether responses are accurate, clear, well reasoned, and aligned with the prompt. You will also check statistical methods, modeling choices, quantitative claims, and possible bias.

• Review AI-generated analytical reasoning, code, and model outputs.
• Write step-by-step reference solutions for complex data problems.
• Fact-check quantitative claims and identify statistical or methodological errors.
• Rate and compare multiple AI responses for correctness and reasoning quality.
• Create detailed prompts and responses for AI training across varied topics.
• Test models for inaccuracies or bias and assess reliability across use cases.

What It Pays And Takes

This is remote, part-time contractor work. The listing is marked entry level, and the role requires strong professional data science experience and advanced technical skills.

• Pay: $60 to $100 per hour.
• Time: 20 or more hours per week.
• Location: Open to candidates in Germany, India, and the United States.
• Language: C1 English proficiency, with the ability to write clear quantitative explanations.
• Education: Bachelor’s degree or higher in data science, computer science, statistics, mathematics, or a closely related quantitative field.
• Experience: 5 or more years as a data scientist or in a closely related analytical role.
• Technical skills: Strong Python, including pandas, NumPy, and scikit-learn; advanced SQL; and experience with large, complex datasets.
• Knowledge: Statistics, experimental design, applied probability, and hands-on machine learning model development, evaluation, and deployment.
• Additional skills: Data visualization or dashboard tools, stakeholder presentations, and careful, systematic work focused on quality and reproducibility.
• Helpful background: AI data training, annotation, AI-generated content review, model evaluation, research-oriented data science, or machine learning with business or product datasets.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that generate text, analyze information, and write code. Contributors review model responses, create examples, and explain what makes an answer accurate or useful, while experienced specialists bring the subject knowledge needed for demanding evaluation work.