Skip to content
OpenTrain AIFor AI Companies

Product Analytics and Experimentation Expert

Create realistic product analytics problems and detailed answers to evaluate AI systems, drawing on experiments, metrics, retention, and growth. Remote contract work pays $115 per hour and requires at least 20 hours per week.

Apply now
OpenTrain AI

Generative AI & RLHF

Remote Hourly · $115/hr

$115/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Nov 6, 2026

Posted

Open in 95 countries

United States
+ more
  • Albania
  • Algeria
  • Antigua and Barbuda
  • Armenia
  • Australia
  • Austria
  • Bahamas
  • Bahrain
  • Belgium
  • Benin
  • Bhutan
  • Bosnia and Herzegovina
  • Botswana
  • Brunei
  • Bulgaria
  • Canada
  • Costa Rica
  • Côte d’Ivoire
  • Croatia
  • Cyprus
  • Czechia
  • Denmark
  • Ecuador
  • El Salvador
  • Estonia
  • Ethiopia
  • Finland
  • France
  • Gambia
  • Germany
  • Greece
  • Guatemala
  • Guyana
  • Hong Kong
  • Hungary
  • Iceland
  • India
  • Indonesia
  • Ireland
  • Israel
  • Italy
  • Jamaica
  • Jordan
  • Kenya
  • Kuwait
  • Latvia
  • Liechtenstein
  • Lithuania
  • Luxembourg
  • Madagascar
  • Malaysia
  • Malta
  • Mauritius
  • Mexico
  • Moldova
  • Mongolia
  • Morocco
  • Mozambique
  • Namibia
  • Netherlands
  • New Zealand
  • North Macedonia
  • Norway
  • Oman
  • Pakistan
  • Panama
  • Peru
  • Philippines
  • Poland
  • Portugal
  • Qatar
  • Romania
  • Rwanda
  • Saint Lucia
  • Senegal
  • Serbia
  • Singapore
  • Slovakia
  • Slovenia
  • South Africa
  • Spain
  • Sri Lanka
  • Sweden
  • Switzerland
  • Taiwan
  • Tanzania
  • Thailand
  • Trinidad and Tobago
  • Tunisia
  • Türkiye
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

The work

You will create product analytics problems based on real product-team decisions, then write reference answers that show the reasoning behind each step. Your examples will help assess whether AI systems can analyze data and make sound analytical judgments.

  • Write problems about experiments, product metrics, retention, and growth.
  • Work through each problem and explain the reasoning in its reference answer.
  • Identify analytical mistakes that may look reasonable but require practical product analytics experience to catch.

What it pays and takes

  • Pay: $115 per hour, paid weekly via Stripe.
  • Hours: At least 20 hours per week; the work is flexible and asynchronous, with participation that can scale up or down.
  • Location: Remote, with applicants limited to eligible countries.
  • Experience: At least three years of full-time work as a data scientist or product analyst on a product team.
  • Skills: Hands-on experience designing or analyzing A/B tests; strong SQL, Python, and applied statistics skills; and strong written English with the ability to explain an analysis clearly.
  • Helpful background: A master's degree in a quantitative field, experience defining product metrics, or experience modeling retention and lifetime value.
  • Work arrangement: Independent contractor role with ongoing project work.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human-written examples and evaluations to help improve and assess AI systems. Experienced product analytics practitioners are needed to create realistic problems and recognize errors that require practical judgment.

OpenTrain is a free platform where people can find AI training projects, build a profile, and start applications.

Requirements

  • Languages: English

Keep exploring

Similar open roles

View all AI training jobs

Plumber Expert for Plumbing Diagnosis and Code Compliance

Create plumbing service scenarios, explain code-based diagnoses, and rate AI answers for safety and workmanship. Remote US contract work pays $50 to $90 per hour and requires an active journeyman or master plumber license.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Hourly · $50–$90/hr

Posted Nov 6, 2026

Mortgage Loan Officer AI Evaluation Expert (English)

Create mortgage lending scenarios and assess AI answers against agency and regulatory guidelines. This remote role pays $70 to $105 per hour and requires an active NMLS license or registration.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Part-time · Flexible
Hourly · $70–$105/hr

Posted Nov 6, 2026

Bilingual Audio Contributor and Expert Reviewer (Mandarin)

Review AI-generated research tables, verify linked sources, and find missing entries in a remote, self-paced project requiring 20+ hours weekly. Fluency in Mandarin Chinese and English is required.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
Chinese
Part-time · Flexible
Hourly pay

Posted Nov 6, 2026

Machine Learning Research Evaluation Expert

Create and solve machine learning research problems, then write reference answers that reveal flawed methods and weak conclusions. This remote contractor role pays $115 per hour and requires at least 20 hours per week.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Part-time · Flexible
Hourly · $115/hr

Posted Nov 6, 2026

Literature Expert for AI Evaluation

Write literary test scenarios, explain readings with textual evidence, and rate AI responses for fidelity and interpretive depth. Pay is $50 to $100 per hour for 20+ hours per week.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Part-time · Flexible
Hourly · $50–$100/hr

Posted Nov 6, 2026