Portuguese AI Personalization Response Evaluator

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI recruits contractors for projects that help improve how modern AI systems understand context, follow instructions, and communicate with people.

Creating an OpenTrain account is free. You can build a profile around your AI training experience, discover relevant projects, and apply in minutes.

• Remote contractor opportunity
• Three-month engagement
• Part-time schedule of 20 to 40 hours per week
• Hourly rate of $15

About AI Training Work

AI training is the human side of building artificial intelligence. Contributors write prompts, compare model responses, identify errors, and explain which outputs are more helpful, natural, and accurate.

Your judgments in this role will help evaluate how AI systems use personal context. Careful human review is essential for identifying unsupported conclusions and improving the quality of model responses.

• Work with cutting-edge AI evaluation tasks
• Use analytical judgment to assess nuanced model behavior
• Build experience in a rapidly growing technology field
• Work remotely with a flexible contractor schedule

The Role

OpenTrain is seeking a Portuguese AI Personalization Response Evaluator to assess whether an AI system uses personal context appropriately when generating responses. You will create realistic conversations, review how information is grounded and integrated, and determine whether responses are helpful, natural, and free from unsupported inferences.

This entry-level contractor engagement lasts three months. The expected commitment is at least four hours per day and up to 40 hours per week, with at least four hours of overlap with Pacific Time.

• Language: Portuguese reading and writing proficiency
• Data type: Text
• Engagement: Contractor and part time
• Schedule: 20 or more hours per week, up to 40 hours per week
• Availability: At least four hours of Pacific Time overlap
• Pay: $15 per hour
• Work location: Worldwide and remote

What You'll Do

You will test personalized AI behavior through structured conversations and provide concise, evidence-based evaluations. Your work will involve both rating response quality and documenting the reasoning behind your judgments.

• Create and execute realistic one- to five-turn conversational prompts based on personal experiences
• Evaluate whether responses follow the intent of the starting prompt
• Check whether personal information is grounded in available evidence
• Identify hallucinations, unsupported personalization, poor inferences, and incorrect claims
• Assess whether personal context is integrated naturally rather than overexplained or presented robotically
• Compare two responses side by side and rank them for helpfulness, ease of use, enjoyment, and overall quality
• Write clear rationales that reference specific turns and explain response strengths and weaknesses
• Verify debugging information and data-source usage
• Delete evaluation conversations to maintain clean future chat history

Requirements

This role requires strong Portuguese reading and writing ability, careful attention to subtle differences in language, and sound judgment when responses are ambiguous. You should be able to work independently in a remote environment with a reliable computer and internet connection.

• Portuguese proficiency for nuanced evaluation work
• Strong analytical judgment for ambiguous AI responses
• Ability to create creative multi-turn prompts grounded in personal context
• Attention to naturalness, grounding, overnarration, and forced connections
• Clear, concise written communication
• Ability to provide constructive feedback
• Independent remote work habits
• Reliable computer and internet access

Helpful Background

A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is relevant to this work. Previous experience in data annotation, AI quality evaluation, content moderation, or a similar area is preferred.

• Entry-level candidates are encouraged to apply
• Relevant analytical or language-focused education and experience
• Previous data annotation or AI evaluation experience is preferred
• Content moderation experience may be useful

How to Apply

Create a free OpenTrain account, build your profile, and apply for this Portuguese AI personalization evaluation opportunity in minutes. Be prepared to demonstrate your ability to design personal-context prompts, identify unsupported personalization and hallucinations, compare responses, and write concise, turn-specific rationales.

• Show Portuguese reading and writing proficiency
• Highlight relevant annotation, AI evaluation, or moderation experience
• Demonstrate careful reasoning about naturalness and grounding
• Confirm your availability for the required schedule and Pacific Time overlap