Program Management AI Evaluation Specialist

About OpenTrain

OpenTrain is the #1 platform for people building careers in AI training and data labeling. We connect skilled contributors with projects that shape how AI systems learn and behave, and we help freelancers build a unified portfolio and durable freelance career in this fast-growing industry.

About AI training work

AI training is the human side of building intelligent systems: people prepare, review, and judge examples that models learn from. This role sits at the intersection of program management and model evaluation—your feedback will directly improve how AI tools draft plans, spreadsheets, and presentations.

The role

OpenTrain is hiring a remote, hourly evaluator focused on program management and implementation planning. You will assess AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality, score them against detailed rubrics, and provide structured written feedback on factual, reasoning, and presentation issues.

• Commitment: 20+ hours per week (part-time, contractor).
• Pay: USD $80–$120 per hour (hourly contractor role).
• Work is fully remote and open to worldwide applicants who meet requirements.
• Primary data type: documents; label types include evaluation ratings and text-generation review.

What you'll do

You will evaluate model outputs for program management quality and communicate actionable, well-structured feedback. Work focuses on clarity, factual correctness, implementation practicality, and presentation.

• Evaluate AI-generated work products against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Write clear, structured feedback grounded in program-management expertise.
• Provide rubric-based ratings and examples to justify scores and suggest improvements.

Requirements

The role requires hands-on program management experience and strong documentation skills. You must be able to spot reasoning flaws, factual mistakes, and presentation problems, then explain them concisely in English.

• Relevant professional experience in program management or implementation planning.
• Native or professional fluency in English (written and reading comprehension).
• Advanced proficiency in Microsoft Office and Google Workspace, especially PowerPoint or Google Slides.
• Experience evaluating AI-generated documents, spreadsheets, or slide decks and producing written feedback.

Helpful background

Candidates with advanced academic credentials or deep domain exposure will have an advantage, but demonstrable program-management experience and strong reviewer skills are most important.

• Advanced degree (master's or higher) from a reputable institution is a plus.
• Prior work reviewing or auditing plans, proposals, or implementation documents helps you provide higher-quality feedback.
• Comfort turning high-level rubric criteria into specific, actionable comments.