Skip to content
OpenTrain AIFor AI Companies

AI Agent Tester

Apply now

Job details

Pay

$25–$45 USD/hr

Engagement

Contract, part-time

Location

Remote

52 countries

Posted

Nov 16, 2026

OpenTrain on Trustpilot

The work

You will test how well AI agents handle everyday tasks on your smartphone. You will compare two agents side by side, guide them through important decisions, and document the results.

Each testing run takes about 1.5 hours, including screen recording, evidence collection, and scoring. Tasks may include bill payments, returns, email follow-ups, bookings, shopping, travel, family logistics, outings, and forms.

  • Run realistic everyday scenarios with two AI agents.
  • Approve or stop agents at important decision points.
  • Record each attempt and collect supporting evidence.
  • Score completion, quality, control issues, satisfaction, and time.
  • Write clear notes about what worked, what did not, and how the experience felt.

Requirements

This is a remote, part-time contractor role with flexible scheduling. You do not need coding skills or prior AI experience, but you must be able to follow detailed instructions and document each step accurately.

  • Each testing run takes approximately 1.5 hours.
  • Remote role, open only in the countries listed for this posting.
  • Fluent in English.
  • Bachelor’s degree or local equivalent.
  • Use AI tools in daily life.
  • Detail-oriented, with clear written communication skills.
  • Personal AI account and a smartphone that can record the screen.
  • Your own debit or credit card for test purchases, such as groceries or a booked service. You buy first and receive reimbursement afterward.
  • No coding or prior AI background required.
  • Skills: ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen Recording, Dots, Mobile

Open to applicants in

  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

Preferred

  • Two to three years of experience in engineering, business management, office work, or operations is preferred.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form. It asks for your resume again, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.
  3. Take a short AI interview.

OpenTrain on Trustpilot

Job ID: cmwjfwywd002x08i3h0sbtds6

Keep exploring

Similar open roles

View all AI training jobs

Trade Compliance Expert AI Evaluator

Use trade compliance expertise to create expert tasks, assess AI-generated answers, and give clear feedback on reporting, export controls, sanctions, and audits. This ongoing remote role pays up to $80 per hour with no set schedule.

Generative AI & RLHF
Text
Remote · United States
English
Flexible hours
Hourly · $80/hr

Posted Nov 16, 2026

Hardware Expert AI Training Specialist

Create, solve, and evaluate rigorous hardware engineering problems for AI training from anywhere, with a flexible commitment of about 15 hours per week. Pay is $60 to $120 per hour equivalent, paid per task that meets the project specifications.

RTLHardware
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

STEM Expert for AI Problem Evaluation

Solve scientific and technical problems, use Python for calculations or simulations, and review AI-generated answers for accuracy. This flexible role offers approximately 15 hours per week and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Biology
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

AI Agent Evaluator

Test AI agents on realistic smartphone tasks such as bookings, shopping, payments, and forms. Earn $25 to $45 per hour on a flexible schedule, with each run taking about 1.5 hours.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United States
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026

AI Trainer / Data Annotator

Review AI-generated responses, rank outputs, label datasets, and give feedback that helps improve machine learning systems. This remote contract role pays $8 to $12 per hour and requires at least 20 hours each week.

Generative AI & RLHF
Text
Remote · Afghanistan, Albania, Algeria +220 more
Part-time · Flexible
Entry level
Hourly · $8–$12/hr

Posted Nov 16, 2026