Business Account Rater (Gmail Personalization)

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people discover projects, build a centralized portfolio, and grow freelance careers doing the human work that teaches AI.

We connect skilled contributors with real AI training work that is remote, flexible, and on the cutting edge of how modern AI models learn from human examples.

About AI training and this kind of work

AI training (data labeling/annotation and human-feedback work) is the human side of building intelligent systems: people evaluate, correct, and rate model outputs so models learn to be more useful and reliable.

This role focuses on evaluating conversational model responses in a business-email context — a form of RLHF and evaluation rating that directly shapes how AI assists professional users.

The role

As a Business Account Rater you will evaluate AI-generated replies that reference or rely on a professional Gmail account. Your judgments will assess relevance, accuracy, tone, and personalization, and your structured feedback will help improve model behavior for business users.

This is a remote, contractor position with a short-term engagement focused on careful judgment, consistency, and strict privacy-aware handling of business account content.

What you'll do

• Use your professional Google Workspace (Gmail) account and recent email history to evaluate model replies.
• Judge whether responses are relevant, accurate, helpful, and appropriately personalized to the user and their business context.
• Compare multiple AI responses and choose which provides the better user experience.
• Spot unsupported assumptions, irrelevant recommendations, or subtle quality and personalization issues.
• Write clear, structured evaluation feedback that model teams can use to improve outputs.
• Follow project guidelines and protect data privacy and confidentiality at all times.

Requirements

You must meet all required qualifications to be considered.

• Native-level proficiency in one target language: Spanish, Italian, Portuguese, German, Japanese, Korean, or French.
• A regularly used Google Workspace corporate Gmail account with most inbox messages in your target language.
• Strong analytical thinking, attention to detail, and ability to spot nuanced personalization issues.
• Clear written communication skills and the ability to produce structured evaluation feedback.
• Bachelor’s degree or equivalent practical experience.
• Comfortable working independently as a contractor and handling business email history with discretion.

Helpful experience and logistics

Helpful background includes prior AI evaluation, data annotation, content review, or QA experience and a well-established business inbox with regular activity.

You should have a reliable desktop or laptop and stable internet access. This project uses evaluation-rating and RLHF-style labeling workflows.

• Engagement: Contractor, part-time.
• Time commitment: 20+ hours/week preferred; project requires at least 4 hours per day and can be up to 40 hours/week.
• Duration: 3 to 4 months.
• Scheduling: Four hours of overlap with US Pacific Time is required.
• Location: Open to candidates based in the United States only.

How to apply and next steps

Create a free OpenTrain account, complete your profile, and apply to this project so our team can review your language and Gmail qualifications.

If selected, you will receive project materials and guidelines explaining the evaluation tasks and privacy rules. All work must follow those guidelines and protect business account confidentiality.