AI Quality Analyst, Portuguese (Portugal)

About OpenTrain

OpenTrain helps people start and grow careers teaching AI. We connect contributors with specialized AI training work, let you build a unified annotation portfolio, and contract talent directly so you can find steady, flexible projects and build skills over time.

About AI training work

AI training (data labeling, annotation, and human feedback) is the human side of building modern AI: people prepare, evaluate, and refine examples that models learn from. This work is highly flexible, often remote, and a fast-growing way to earn while shaping how AI behaves.

• Flexible, remote work you can do from a laptop or desktop with internet.
• Entry and mid-level projects that reward attention to detail and clear judgment.
• Work directly influences model behavior and product safety.

The role

You will be an AI Quality Analyst focused on evaluating a new personalization feature for a conversational AI. In this contractor, part-time role you will design multi-turn prompts that draw on your own personal context, judge how well the model uses that information, and produce clear, ranked comparisons between two model responses.

• Position type: Contractor, Part-time.
• Time commitment: 20+ hours per week.
• Pay: $15 USD per hour.

What you'll do

• Design and run multi-turn conversational prompts (typically 1–5 turns) that require the AI to use your personal information and experience.
• Evaluate model replies for appropriate personalization relative to your original intent.
• Analyze responses for grounding issues, integration quality, and overall helpfulness.
• Stack-rank two model responses side-by-side to decide which is more helpful, usable, and enjoyable.
• Write clear, defensible rationales for your comparisons, citing specific turn numbers.
• Maintain strict data hygiene by deleting evaluation conversations so they do not appear in future chat history.

Requirements

• Fluency in Portuguese (reading and writing) at a high level.
• Experience in data annotation, AI quality evaluation, content moderation, or related roles.
• Creative prompt engineering skills using personal context.
• Strong analytical thinking to evaluate nuanced and ambiguous AI responses.
• Excellent written communication for structured, defensible rationales.
• Meticulous attention to detail for side-by-side comparisons.
• Self-motivated, able to work independently in a remote setting.
• Desktop or laptop computer with a stable internet connection.
• Availability to commit 20+ hours per week as a contractor.

Helpful background

The following qualifications are useful but not required; they help with faster onboarding and more advanced work.

• Degree or equivalent experience in Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or another analytical field.
• Familiarity with personalization failure modes: incorrect personalization, poor inferences, or forced connections.
• Experience with side-by-side evaluation methodologies and writing comparative rationales.

How it works & compensation

OpenTrain AI hires contractors directly and manages the evaluation work. You will receive tasks through your OpenTrain profile, complete multi-turn evaluations, and submit ranked comparisons and written rationales.

Compensation is paid per hour at $15 USD/hour. This role is remote and open worldwide, though Portuguese reading and writing proficiency is required. You are responsible for maintaining your own device and internet access.

• Work is paid hourly; confirm payment details and schedule in your OpenTrain profile.
• All evaluation conversations must be deleted after the task to protect future chat history and maintain data hygiene.