Portuguese-Speaking AI Response Evaluator

You will test whether an AI system uses personal context correctly when writing responses. You will create realistic conversations, review the results, compare response quality, and explain your decisions in clear written notes.

• Create and run realistic conversations based on personal experiences, usually lasting one to five turns.
• Check whether responses follow the starting prompt and use personal information appropriately.
• Look for unsupported claims, hallucinations, poor inferences, and incorrect personalization.
• Assess whether personal details sound natural instead of overexplained or robotic.
• Compare two responses and rank them for helpfulness, ease of use, enjoyment, and overall quality.
• Write concise rationales that cite specific turns and explain each response's strengths and weaknesses.
• Verify debugging information and data-source usage, then delete evaluation conversations to keep future chat history clean.

What it pays and takes

This is an entry-level contractor engagement focused on careful judgment of AI-generated text. Prior experience in related work is preferred, but the role also welcomes relevant education or equivalent analytical experience.

• Pay: $15 per hour.
• Engagement: Three months as a contractor.
• Time: At least four hours per day, from 20 or more hours per week up to 40 hours per week.
• Schedule requirement: Four hours of overlap with Pacific Time.
• Location: Worldwide remote work, with reliable computer and internet access.
• Language: Strong Portuguese reading and writing proficiency.
• Requirements: Analytical judgment, creative prompt writing, attention to subtle language differences, clear communication, and the ability to work independently.
• Helpful background: A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field.
• Preferred experience: Data annotation, AI quality evaluation, content moderation, or similar work.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that generate text and other outputs. Contributors create examples, review model responses, and explain which answers are accurate, useful, and natural, so careful judgment is valuable even when the work is entry level.