Data Scientist Expert for AI Model Evaluation

You will create realistic analytical problems and complete reference answers used to evaluate and improve AI models. The work draws on practical data science judgment and clear written explanations.

• Write problems based on practical data science work.
• Develop complete reference answers and explain the reasoning behind each step.
• Review approaches to experiments, metrics, forecasting, segmentation, and predictive modeling.
• Catch subtle statistical and methodological errors that may be easy to miss.

What it pays and what you need

• Pay: $115 per hour.
• Experience: At least three years working full time as a data scientist.
• Education: A master's or PhD in statistics, computer science, economics, mathematics, or another quantitative field.
• Skills: Strong SQL and proficiency in Python or R.
• Practical experience with A/B testing, regression, causal inference, or predictive modeling.
• Communication: Clear written English and the ability to explain analytical reasoning.

Helpful background

Experience on product, growth, or marketplace teams is helpful, as is experience designing and presenting experiments. Being able to explain analyses step by step is also valuable.

Where the role is open

• Location: Open to candidates in Albania, Algeria, Antigua & Barbuda, Armenia, Australia, Austria, the Bahamas, Bahrain, Belgium, Benin, Bhutan, Bosnia & Herzegovina, Botswana, Brunei, Bulgaria, Canada, Costa Rica, Côte d’Ivoire, Croatia, Cyprus, Czechia, Denmark, Ecuador, El Salvador, Estonia, Ethiopia, Finland, France, the Gambia, Germany, Greece, Guatemala, Guyana, Hong Kong SAR China, Hungary, Iceland, India, Indonesia, Ireland, Israel, Italy, Jamaica, Jordan, Kenya, Kuwait, Latvia, Liechtenstein, Lithuania, Luxembourg, Madagascar, Malaysia, Malta, Mauritius, Mexico, Moldova, Mongolia, Morocco, Mozambique, Namibia, the Netherlands, New Zealand, North Macedonia, Norway, Oman, Pakistan, Panama, Peru, the Philippines, Poland, Portugal, Qatar, Romania, Rwanda, Senegal, Serbia, Singapore, Slovakia, Slovenia, South Africa, Spain, Sri Lanka, St. Lucia, Sweden, Switzerland, Taiwan, Tanzania, Thailand, Trinidad & Tobago, Tunisia, Türkiye, the United Arab Emirates, the United Kingdom, the United States, Uzbekistan, and Vietnam.
• Also open in: Ecuador, Estonia, Spain, Ethiopia, Finland, France, United Kingdom, Gambia, Greece, Guatemala, Guyana, Hong Kong, Croatia, Hungary, Indonesia, Ireland, Israel, India, Iceland, Italy, Jamaica, Jordan, Kenya, Kuwait.
• Also open in: Saint Lucia, Liechtenstein, Sri Lanka, Lithuania, Luxembourg, Latvia, Morocco, Moldova, Madagascar, North Macedonia, Mongolia, Malta, Mauritius, Mexico, Malaysia, Mozambique, Namibia, Netherlands, Norway, New Zealand, Oman, Panama, Peru, Philippines.
• Also open in: Pakistan, Poland, Portugal, Qatar, Romania, Serbia, Rwanda, Sweden, Singapore, Slovenia, Slovakia, Senegal, El Salvador, Thailand, Tunisia, Turkey, Trinidad and Tobago, Taiwan, Tanzania, United States, Uzbekistan, Vietnam, South Africa.

How to apply

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind building AI: people create and review examples that models learn from. Data scientists bring practical expertise to these tasks by creating sound analytical problems and spotting errors in model reasoning.