User Research And Feedback Synthesis Evaluator

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people start and grow careers teaching AI: discover projects, build a profile, and apply in minutes — creating an OpenTrain account is free.

OpenTrain AI is the hiring and contracting organization for this role. Join a community of contributors who directly shape how state-of-the-art AI systems behave.

Why AI Training Work Matters

AI systems learn from examples prepared and reviewed by people. Work in AI training (data labeling, annotation, and human feedback) is the human side of building AI — it’s remote, flexible, and a fast-growing way to work in tech.

This role puts you on the front lines of model evaluation: your judgments and feedback improve model outputs and help set quality standards across document, spreadsheet, and slide-deck generation.

• 100% remote — work from anywhere with a computer and internet.
• Flexible hours — good for part-time and freelance schedules.
• Contribute to cutting-edge model behavior through structured, professional feedback.

The Role

We are hiring a User Research and Feedback Synthesis Evaluator to review AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality. You will evaluate outputs against domain-specific rubrics, surface factual and presentation issues, and write clear feedback that supports high-quality grading decisions.

This is a contractor, part-time opportunity expected to require 20+ hours per week. The role is worldwide and conducted in English.

• Employment type: Contractor, Part-time.
• Time commitment: 20+ hours/week.
• Work location: Remote, worldwide (English required).

What You’ll Do

Your primary responsibility is to apply domain-specific rubrics to AI-generated deliverables and produce actionable, well-structured feedback that explains grading decisions and identifies improvement areas.

You will routinely judge content quality across factual correctness, logical rigor, aesthetic and presentation quality, and alignment to stated criteria.

• Review documents, spreadsheets, and slide decks produced by AI.
• Grade outputs according to domain-specific quality rubrics.
• Identify factual errors, inconsistencies, and presentation/aesthetic problems.
• Write concise, structured feedback grounded in the review criteria.

Requirements

Candidates must meet the stated professional and technical requirements below. We preserve every substantive requirement from the role description.

This role is expert-level and expects demonstrable experience and strong software proficiency.

• 5+ years of professional experience in user or customer research and feedback synthesis.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Google Slides or PowerPoint.
• Strong written communication and the ability to produce clear, structured feedback.
• Ability to evaluate AI-generated work against domain-specific quality rubrics.

Helpful Background

An advanced degree (master’s or higher) from a reputable institution is listed as helpful but not strictly required. Applicants with equivalent professional experience and demonstrable expertise in user research and feedback synthesis are encouraged to apply.

This role benefits from experience assessing presentation quality, synthesizing qualitative research findings, and producing actionable recommendations for content improvement.

Compensation, Data Types & Tools

Pay is hourly (USD) at $80–$120 per hour; the listed hourly rate is $120, with a range of $80–$120. The role is paid per hour and structured as a contractor position.

You will work with document-type outputs and perform evaluation and text-generation labeling tasks. Familiarity with standard office suites (Google Workspace, Microsoft Office) is required.

• Payment type: Pay per hour (USD).
• Hourly rate: $80–$120/hr (listed rate: $120/hr).
• Data type: Document (documents, spreadsheets, slide decks).
• Labeling tasks: Evaluation rating and text generation review.

How To Apply

Create an OpenTrain account (free) and submit your application. Include a resume that highlights 5+ years of user/customer research or feedback synthesis, examples of relevant work if available, and details on your Microsoft/Google Workspace proficiency.

Shortlisted applicants may be asked to complete a paid evaluation task to demonstrate grading approach and feedback style.

• Provide clear examples or descriptions of past user research and feedback synthesis work.
• Be prepared to demonstrate your ability to write structured feedback and apply rubrics.