Image Quality Scoring — Part-Time Remote Role

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We hire and contract contributors to help train modern AI systems by providing high-quality human judgments and annotations.

This position is offered directly by OpenTrain AI as part of our mission to create accessible, flexible work opportunities that shape how state-of-the-art AI behaves.

About AI Training Work

AI training (also called data labeling or annotation) is the human side of building machine intelligence. Your ratings and evaluations help models learn which images are high quality and which are not, improving performance across photography, vision systems, and research.

Work is 100% remote, often flexible, and a great way to earn while doing detailed, meaningful work that directly influences AI behavior.

The Role

As an Image Quality Scorer you will review and rate images using established image quality metrics and assessment tools. Your judgments will be used to evaluate automated metrics and to create ground-truth labels for research and model validation.

This is a contractor, part-time role requiring consistent weekly availability (minimum 20 hours) and experience with image quality evaluation or annotation.

• Data type: images
• Labeling task type: evaluation / rating
• Employment: Contractor, Part-time
• Location: Remote — worldwide

What You'll Do

Perform systematic image quality assessments according to provided guidelines and rubrics. Use image quality assessment tools to compare images and assign ratings.

Document edge cases and inconsistencies you encounter, and provide clear feedback to improve guidelines and metric calibration.

• Rate images on factors such as sharpness, exposure, noise, compression artifacts, and overall visual quality.
• Follow annotation instructions and apply rating scales consistently across images.
• Flag ambiguous or low-confidence examples for review and discussion.

Requirements

You must meet the stated minimums and be able to follow detailed instructions while maintaining consistent judgment across tasks.

We preserve all role details exactly as provided: availability, experience level, and language requirement.

• Minimum 20 hours availability per week
• Intermediate experience with image quality evaluation or image annotation
• Fluent English proficiency (reading and writing)
• Reliable internet access and a device suitable for viewing images at full resolution

Who Should Apply

This project is a fit for photographers, image annotators, visual QA specialists, and anyone with hands-on experience evaluating photo or image quality who wants steady part-time remote work.

If you enjoy careful visual review, can apply rating scales consistently, and want to contribute to how AI systems interpret image quality, this role is a strong match.

Compensation & Logistics

Pay is hourly and ranges from USD 5 to USD 7 per hour, paid per the OpenTrain payment schedule. This is a contractor role with part-time hours; exact scheduling is set by project needs and your stated availability.

OpenTrain hires worldwide for this project. No specific local residency or language pair restrictions beyond fluent English are required.

• Payment type: Pay per hour
• Hourly rate: $5–$7 USD
• Minimum weekly commitment: 20+ hours

How It Works

Apply through OpenTrain, complete any onboarding and qualification tests, and start reviewing images once approved. You will receive detailed guidelines and examples before you begin rating at scale.

Provide consistent, high-quality ratings and follow feedback from reviewers to remain active on the project.