Skip to content
OpenTrain AIFor AI Companies

AI Quality Analyst, Gemini Personalization

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

Worldwide

Posted

Jul 17, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for an AI Quality Analyst to evaluate a new personalization feature for Gemini. In this contractor role, you will assess how well the model uses information from past Gemini conversations, Gmail, Google Search, and YouTube activity to make responses more relevant and helpful. This is a hands-on evaluation role that combines creative prompt design with rigorous analytical assessment of model outputs.

What you will do
- Design and execute multi-turn conversational prompts (typically 1 to 5 turns) that require the AI to utilize your personal information and experiences
- Evaluate model responses based on your intent, checking if personalization was appropriately applied
- Analyze responses for Grounding issues, ensuring claims are supported by evidence not flawed inferences or hallucinations
- Assess Integration quality to ensure personal data is woven naturally into responses without robotic overnarrating
- Rigorously evaluate and stack-rank two model responses side-by-side to determine which is overall more helpful, easy to use, and enjoyable
- Write clear, defensible rationales for your comparisons, explicitly referencing specific turn numbers

Required skills
- English Proficiency: Ability to read and write in English with a high degree of comprehension

- Exceptional analytical thinking and ability to evaluate nuanced and ambiguous AI responses
- Experience in designing creative, multi-turn prompts based on personal context
- Strong understanding of personalization concepts
- Meticulous attention to detail for reviewing side-by-side model responses
- Excellent written communication skills
- Desktop or laptop with a good internet connection

Helpful background
- BS/BA degree or equivalent in Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related analytical field
- Experience in data annotation, AI quality evaluation, content moderation, or a related role

Engagement details
- Contractor engagement for 3 months
- Commitment of at least 4 hours per day up to 40 hours per week with 4 hours overlap with PST

Requirements

  • Languages: English

Open worldwide

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmroshmh2000609kkh5he5wmx

Keep exploring

Similar open roles

View all AI training jobs

Gemini Education AI Response Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Communication
Text
Remote · Worldwide
English
Part-time · Flexible
Hourly · $20/hr

Posted Oct 28, 2026

Business Data Quality Analyst

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PIIData PrivacyDocument ReviewData AnalysisQuality Assurance
Documents
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $31–$60/hr

Posted Sep 9, 2026

AI Personalization Quality Evaluator (Polish)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Domain-Specific Languages
Text
Remote · Worldwide
Polish
Part-time · Flexible
Hourly · $20/hr

Posted Jul 20, 2026

AI Quality Analyst - Thai Personalization

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Domain-Specific Languages
Text
Remote · Worldwide
Thai
Flexible hours
Intermediate level
Hourly · $15/hr

Posted Jul 16, 2026

AI Personalization Quality Analyst (Hindi)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Domain-Specific Languages
Text
Remote · Worldwide
Hindi
Part-time · Flexible
Hourly · $15/hr

Posted Jul 16, 2026