About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for an AI Quality Analyst to evaluate a new personalization feature for Gemini, a leading AI model. In this role, you will design creative prompts, assess model responses for personalization quality, and provide detailed evaluations. This is a contractor role with a focus on Hindi language evaluation.
What you will do
- Design and execute multi-turn conversational prompts (1-5 turns) to test the model's use of personal information.
- Evaluate model responses for grounding, integration, and helpfulness.
- Stack-rank two model responses side-by-side to determine overall quality.
- Write clear rationales referencing specific conversation turns.
- Extract and verify debug info to confirm proper data source utilization.
- Maintain data hygiene by deleting evaluation conversations.
Required skills
- Hindi proficiency (reading and writing).
- Analytical and critical thinking skills.
- Experience with prompt engineering.
- Excellent written communication.
- Full-time availability with 4 hours overlap with PST.
Helpful background
- BS/BA degree in a relevant field.
- Experience in data annotation, AI quality evaluation, or content moderation.