Personal Account AI Response Rater — German or Korean

About OpenTrain

OpenTrain is the #1 platform for people building careers in AI training and data labeling. We help contributors find and grow work that trains real AI systems — from short projects to durable freelance careers — and manage profiles and opportunities in one place.

This role is hired and contracted by OpenTrain. You will be part of a fast-growing industry where human reviewers directly shape how AI systems behave.

About This Project

This personalization evaluation project focuses on AI-generated responses and their fit with an individual's email history. You will review prompts and candidate responses and judge how well they reflect the inbox history, language mix, and user intent.

The work contributes to RLHF-style evaluation and response-ranking workflows: you will rate outputs, spot incorrect personalization, and choose which response creates a better user experience.

What You'll Do

You will evaluate AI responses relative to your own email account and provide objective, written feedback that helps the model improve personalization and helpfulness.

• Evaluate AI-generated responses against your personal Gmail history and account activity.
• Assess relevance, personalization quality, helpfulness, and factual accuracy.
• Review prompts and responses in English while considering English and your native language.
• Identify incorrect personalization, unsupported assumptions, and irrelevant recommendations.
• Compare multiple AI responses and select the stronger user experience with clear reasons.
• Follow privacy and confidentiality rules when working with your account data.

Requirements

Candidates must meet all required items below. This is an entry-level-friendly evaluation role but requires native fluency and an active, well-used email account.

• Native fluency in German or Korean (you must be a native speaker).
• Comfort reading and evaluating prompts and AI-generated responses in English.
• A primary personal Gmail account used as your main email address.
• A well-established inbox containing a meaningful mix of English and your target language.
• Strong analytical thinking, attention to detail, and clear written communication.
• Ability to work independently and reliably in a remote contractor role.

Helpful Background

You don't need prior AI industry experience, but previous work in evaluation, annotation, content review, or QA is helpful. A bachelor's degree or equivalent practical experience is also useful but not required.

• Experience in AI evaluation, data annotation, content review, or quality assurance is a plus.
• Comfort comparing responses objectively and writing concise justification for your choices.

Schedule, Location & Logistics

This is a contractor, part-time engagement lasting about 3 to 4 months. OpenTrain hires directly; work is fully remote but limited to candidates in Germany (DE) or South Korea (KR).

Typical scheduling expectations are 4 hours per day (roughly 20–40 hours per week, depending on assignment), with a requirement to overlap 4 hours each day with Pacific Standard Time. Maintain confidentiality and follow all privacy instructions when accessing your Gmail data.

• Engagement length: 3–4 months.
• Time commitment: commonly 4 hours/day (20–40 hrs/week depending on project needs).
• Daily requirement: 4 hours overlap with PST.
• Employment type: Contractor, part-time.
• No pay details are specified in this posting; compensation will be provided by OpenTrain under the contractor agreement.

How to Apply

If you meet the requirements and are interested, apply through your OpenTrain account. Include your native language (German or Korean), your experience with AI evaluation or content review (if any), and confirm you have a primary Gmail account with the required language mix.

Successful applicants will be given full privacy and safety instructions before any work begins. OpenTrain will provide task guidelines and examples to ensure consistent, high-quality ratings.

• Prepare to demonstrate language fluency and your ability to read English evaluations.
• Be ready to follow confidentiality practices when accessing your personal email for evaluations.