About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for an AI Product Evaluator to conduct detailed evaluations of AI models and agents. You will follow pre-defined scenarios to test accuracy, reasoning, and responsiveness, document findings, and submit datasets on AI training platforms. This role supports a high-impact AI training project.
What you will do
- Evaluate AI models and agents using detailed guidelines and scenarios.
- Execute operational tasks to test model accuracy and reasoning.
- Document findings, observations, and anomalies in structured reports.
- Reset usage limits and repeat evaluations as per project protocols.
- Record and submit evaluation datasets on AI training platforms.
- Maintain high attention to detail and rigor across all tasks.
Required skills
- Experience with AI products, models, or AI agent evaluation and testing.
- Ability to follow complex instructions with precision and consistency.
- Exceptional attention to detail and operational thoroughness.
- Comfort with repetitive or high-volume operational tasks within strict timeframes.
Helpful background
- Background in digital product testing, software QA, or AI research.
- Regular daily use of AI tools and models.
Additional details
This is a remote contract position available to candidates located in India, Japan, or the United Kingdom. Hourly pay ranges from $14 to $36 depending on experience.
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 7 screening questions.