Marketing Media Content AI Evaluation Specialist

You will create and assess AI training tasks across market research and analytics, media production and direction, and editorial and technical communications. The work uses your professional judgment to decide whether AI outputs are accurate, clear, consistent, and fit for the task.

You will work through structured calibration and review cycles. Senior contributors may review peer work, resolve unclear cases, and identify differences between scoring rubrics.

• Design challenging tasks for your professional discipline.
• Create realistic workplace scenarios and gold-standard solution sets.
• Build and apply rubrics for accuracy, terminology, and overall quality.
• Score AI outputs and explain editorial, methodological, or artistic critiques.
• Identify logical inconsistencies, formatting errors, and deviations from the rubric.
• Improve deliverables through feedback and repeated critique cycles.

What it takes

This role is marked as entry level. The work also calls for demonstrable industry experience in at least one relevant area and the ability to make careful, consistent judgments during structured reviews.

• Experience in market research and analytics, media production and direction, or editorial and technical communications.
• Three to 15 or more years of relevant industry experience, depending on your background.
• Strong written communication and documentation skills.
• Ability to explain critiques objectively and support decisions with clear reasoning.
• Careful attention to detail when reviewing logic, formatting, terminology, and rubric requirements.
• A bachelor's degree or equivalent practical experience in any field.
• English fluency.
• Experience with AI evaluation, data annotation, content review, quality assurance, or analytical work is helpful but not required.

Schedule and engagement

This is a 12-week contractor engagement. The schedule is part time or full time within the stated availability range, with required overlap during Pacific Time.

• Availability of at least 4 hours per day and up to 40 hours per week.
• At least 20 hours per week.
• Four hours of overlap with Pacific Time.
• Open worldwide.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human side of building artificial intelligence. Contributors create examples, review model responses, and apply expert standards so AI systems produce more accurate and useful results.