AI Image and Video Evaluation Specialist

About OpenTrain

OpenTrain is the #1 platform for building careers in AI training and data labeling. We help freelancers discover projects, centralize proof-of-work, and grow a durable portfolio of AI training experience.

Working with OpenTrain means joining a community that makes specialized AI training work easier to track, apply for, and turn into a long-term freelance career.

About AI Training Work

AI training (also called data labeling or annotation) is the human work that teaches AI systems how to see, speak, and reason. For visual models, expert human judgments on images and video are essential: you help models learn correct composition, realism, and coherence by providing structured feedback.

This role sits at the intersection of visual media craft and applied evaluation: your assessments directly shape how generative image and video models behave.

The Role

We are recruiting an AI Image & Video Evaluation Specialist to perform generative visual evaluation tasks. You will evaluate AI-generated images and videos against project rubrics, document evidence-based judgments, and write clear feedback that developers use to improve model outputs.

This is a remote, part-time contractor position available to candidates based in the US, Canada, or Great Britain who can work Pacific Time business hours.

• Employment type: Contractor, Part-time
• Hours: 20+ hours/week (minimum commitment)
• Location: Remote — applicants in US, CA, GB only
• Language: Fluency in English required

What You'll Do

Your daily work is careful, consistent evaluation and reporting. You will review AI-generated visuals, compare outputs across models, and apply detailed rubrics to produce objective ratings and written explanations.

• Evaluate model outputs and apply project rubrics to assign ratings (EVALUATION_RATING).
• Compare source materials and multiple model outputs to judge improvements or regressions.
• Document evidence-based judgments and explain reasoning so feedback is actionable.
• Maintain consistency and quality across repeated review tasks and follow detailed instructions.

Requirements

Candidates must demonstrate relevant experience or expertise evaluating visual media and generative outputs. The role is entry-level friendly but requires domain knowledge in visual quality assessment and strong written communication.

• Experience evaluating AI-generated images and videos for visual quality.
• Ability to compare outputs across multiple generative AI models or platforms.
• Skill judging realism, composition, color, lighting, anatomy, text rendering, coherence, and artifacts.
• Strong analytical writing for clear, objective reports and feedback.
• Comfort working independently on remote contractor tasks and following structured workflows.
• Familiarity with visual quality assurance, documentation tools, or structured review workflows.
• Fluent English required; applicants must be located in US, CA, or GB.

Schedule, Pay, and Logistics

This role runs during Pacific Time business hours, Monday–Friday, 9:00 AM to 5:00 PM PT. Expect to work at least 20 hours per week; schedule details and exact shifts will be set in project onboarding.

Pay is hourly: $30–$40 per hour (USD), depending on experience and project needs. You will work as a contractor and invoice according to OpenTrain contract terms.

• Hourly rate: $30–$40 USD per hour
• Work window: PT business hours, Mon–Fri 9:00 AM–5:00 PM PT
• Minimum weekly commitment: 20+ hours

How to Apply and What Happens Next

Build or update your OpenTrain profile to showcase relevant visual evaluation experience and examples of work. Applications are reviewed by OpenTrain, and qualified candidates will be invited to a short qualification task to demonstrate rubric application and writing clarity.

If selected, you will receive project-specific onboarding, rubric training, and access to the annotation workspace. Regular feedback and opportunities to grow your portfolio on OpenTrain follow satisfactory performance.

• Prepare examples or notes describing prior image/video evaluation experience.
• Be ready to complete a short qualification exercise that tests rubric use and written feedback.
• Successful contractors receive onboarding, guidelines, and access to project tools.