About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Portuguese AI Personalization Quality Analyst to evaluate how conversational AI uses personal context to make responses more relevant and helpful. You will create realistic multi-turn prompts based on your own experiences, review personalized responses for grounding and natural integration, and identify unsupported inferences, forced connections, or other quality issues. This contractor role combines careful model evaluation, creative prompt design, side-by-side ranking, and structured written feedback.
What you will do
Design and execute multi-turn conversational prompts, typically spanning one to five turns, that require the model to use relevant personal information and experiences. Judge whether responses follow the intent of the starting prompt and apply personalization appropriately. Check claims about the user for evidence, accuracy, and freedom from flawed inferences. Assess whether personal information is integrated naturally rather than unnecessarily narrated or repeated. Compare model responses side by side and rank them for helpfulness, usability, enjoyment, and overall quality. Write concise, defensible rationales that reference specific conversation turns and explain strengths and weaknesses.
Required skills
Strong Portuguese reading and writing ability, excellent analytical judgment when evaluating nuanced or ambiguous AI responses, and the ability to create creative multi-turn prompts grounded in personal context. You should understand personalization quality, including grounding, incorrect personalization, poor inferences, forced connections, and naturalness. Clear, structured written communication, attention to detail, reliable computer and internet access, independence, and effective remote communication are required.
Helpful background
A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful. Previous experience in data annotation, AI quality evaluation, content moderation, or a related area is preferred.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.