Portuguese AI Quality Analyst

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people discover projects, build a professional AI training profile, and apply in minutes.

As an OpenTrain contractor, you can work remotely, manage your AI training experience, track project work, and develop a portfolio that reflects your growing expertise. Creating an OpenTrain account is free.

• Remote freelance contract opportunity
• Flexible work supporting a growing AI career
• OpenTrain support for building your AI training profile

About AI Personalization Evaluation

AI training is the human side of building modern artificial intelligence. Contributors write prompts, review model outputs, compare responses, and provide structured feedback that helps AI systems become more accurate, relevant, and useful.

In this role, you will evaluate a personalization feature for a generative AI model. Your judgments will help assess whether the model uses relevant personal context appropriately while maintaining helpful, high-quality responses.

• Contribute to the development of cutting-edge AI
• Evaluate model behavior through realistic conversations
• Use language and analytical skills in flexible remote work

The Role

OpenTrain is seeking a Portuguese AI Quality Analyst to evaluate how effectively a generative AI model uses personal information from connected Google services to produce relevant and helpful answers.

This is an entry-level, part-time freelance contractor role paying $15 per hour. The opportunity requires 20 or more hours per week, full-time availability in your local time zone, and four hours of overlap with Pacific Time.

• Role: AI Quality Analyst, Portuguese
• Work arrangement: Remote freelance contract
• Schedule: 20+ hours per week
• Pay: $15 USD per hour
• Language: Portuguese reading and writing fluency
• Worldwide opportunity

What You’ll Do

You will create realistic, multi-turn conversations that test whether the model can use personal context effectively. You will then assess and compare its responses using defined quality criteria and document your reasoning clearly.

The work also includes maintaining data hygiene by deleting evaluation conversations after completing assessments.

• Design and execute multi-turn prompts using personal information and experiences
• Evaluate responses for grounding, integration, and helpfulness
• Rank two model responses side by side
• Write clear rationales explaining comparison decisions
• Delete evaluation conversations to maintain data hygiene

Requirements

This role is suited to a thoughtful evaluator who can recognize subtle differences in AI responses and explain decisions in precise written Portuguese or English as applicable to the evaluation workflow. You must be comfortable using a personal Google account for assessment.

• Fluency in Portuguese, including reading and writing
• Strong analytical thinking for nuanced and ambiguous AI responses
• Experience designing creative prompts to test personalization
• Excellent written communication and documentation skills
• BS or BA degree, or equivalent experience in a relevant analytical field
• Full-time availability in your local time zone with four hours of overlap with PST
• Willingness to use a personal Google account for assessment

Helpful Background

Previous experience is not required for this entry-level opportunity, but relevant exposure can help you succeed. Familiarity with how AI systems are evaluated and how personalization affects model behavior is especially useful.

• Data annotation experience
• AI quality evaluation experience
• Content moderation experience
• Familiarity with personalization concepts
• Experience with side-by-side model evaluation

Why Do AI Training Work

AI training and data labeling offer a way to participate directly in how modern AI systems are built. Work can be completed remotely with a computer or phone and an internet connection, making it possible to fit projects around other commitments.

By reviewing and improving model responses, you help shape how AI communicates and responds to people. OpenTrain gives you a place to grow your experience, manage your work, and build a durable career in this fast-growing field.

• Work remotely from anywhere
• Build experience in generative AI evaluation
• Choose flexible work around your schedule
• Develop a portfolio of AI training expertise