About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Russian AI Personalization Evaluator to assess personalized conversational AI interactions. You will create multi-turn prompts grounded in personal context, review how models use relevant information, and judge whether responses are helpful, natural, and supported by evidence. The work focuses on identifying inaccurate personalization, weak inferences, hallucinations, forced connections, and unnecessary narration while producing clear feedback for AI quality improvement.
What you will do
Design and execute multi-turn conversational prompts that test the use of personal context. Evaluate whether responses follow the intent of the starting prompt and apply personalization appropriately. Check whether claims about the user are supported by available evidence. Assess whether personal information is integrated naturally and usefully rather than presented mechanically. Compare and rank model responses side by side for helpfulness, ease of use, naturalness, and overall quality. Write concise, defensible rationales that reference specific conversation turns and explain strengths and issues. Review debugging information to verify that conversation summaries and data sources were used correctly. Maintain careful data hygiene by deleting evaluation conversations.
Required skills
Proficient written and reading ability in Russian. Strong analytical reasoning for nuanced AI response judgments. Experience creating creative, multi-turn prompts from personal context. Ability to recognize inaccurate personalization, unsupported inferences, hallucinations, and forced connections. Excellent written communication and attention to subtle differences between responses. Ability to provide constructive feedback and detailed annotations independently. Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation. A reliable desktop or laptop and internet connection are required.
Helpful background
A bachelor's degree or equivalent experience in a relevant field such as policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful. Previous work in data annotation, AI quality evaluation, content moderation, or a related area is also valuable.
Schedule and engagement
This remote contractor engagement lasts 3 months and pays $15 per hour. Availability of at least 4 hours per day, up to 40 hours per week, is required, including 4 hours of overlap with Pacific Time.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.