About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Portuguese AI Personalization Response Evaluator to assess whether an AI system uses personal context appropriately when generating responses. You will design realistic multi-turn conversations based on personal experiences, review how information is grounded and integrated, and judge whether responses are helpful, natural, and free from unsupported inferences. This work supports AI quality evaluation through careful comparison, annotation, and written reasoning.
What you will do
Create and execute conversational prompts, generally covering one to five turns, that test the use of personal context. Evaluate whether responses follow the intent of the starting prompt and apply personalization appropriately. Check claims about the contributor for evidence, identifying hallucinations, poor inferences, and incorrect personalization. Assess whether personal information is integrated naturally rather than overexplained or presented robotically. Compare two responses side by side and rank them for helpfulness, ease of use, enjoyment, and overall quality. Write clear rationales that reference specific turns and explain the strengths or weaknesses of each response. Verify debugging information and data-source usage, then delete evaluation conversations to maintain clean future chat history.
Required skills
Portuguese reading and writing proficiency. Strong analytical judgment for nuanced and ambiguous AI responses. Ability to create creative multi-turn prompts from personal context. Careful attention to subtle differences in naturalness, grounding, and overnarration. Clear, concise written communication and the ability to provide constructive feedback. Independent remote work habits and reliable computer and internet access.
Helpful background
A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is relevant. Previous work in data annotation, AI quality evaluation, content moderation, or a similar area is preferred.
Engagement details
This is a contractor engagement lasting three months. The expected commitment is at least four hours per day and up to 40 hours per week, including four hours of overlap with Pacific Time. The offered rate is 15 dollars per hour.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.