Robotics Video Annotation Evaluator

The work

You will review short videos showing robots or people performing actions. You will decide whether each clip follows written instructions, completes the required actions, and reaches the defined end state.

You will also improve AI-generated annotations and record clear decisions using project rubrics. The work focuses on movement, object interaction, action order, and the quality of action labels and descriptions.

• Review robotic and human activity against written directives and project guidelines.
• Assess whether actions are accurate, complete, and aligned with the required end state.
• Compare video samples and identify which one better follows a specified instruction.
• Correct or expand AI-generated annotations, including action boundaries, descriptions, and feedback points.
• Identify subtle differences in movement, object use, and action sequencing.
• Document observations, corrections, and evaluation decisions clearly.
• Apply detailed rubrics consistently to help maintain reliable annotation quality.

What it pays and takes

This is a remote, part-time contractor role for English speakers. Prior AI experience is not required, but you must be comfortable making careful visual judgments and explaining your decisions in writing.

• Pay: $15-$80 USD per hour.
• Time: 20 or more hours per week.
• Work arrangement: Remote contractor role.
• Language: English.
• Availability: Open to applicants in the countries listed for this role.
• Level: Entry level.
• Strong visual analysis and close attention to detail.
• Ability to interpret written instructions, defined end states, and evaluation rubrics.
• Sound judgment when comparing videos and determining instruction compliance.
• Clear written communication for documenting observations and decisions.
• Motion graphics or visual media experience is relevant, but not required.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training work uses human reviews, labels, and feedback to help artificial intelligence learn from real examples. OpenTrain is the hiring and contracting organization for this role, connecting contributors with work that improves the accuracy and consistency of AI systems.