Skip to content
OpenTrain AIFor AI Companies

AI Agent Tester for Real-World Task Evaluation

Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor role pays $25 to $45 per hour.

Apply now
OpenTrain AI

Generative AI & RLHF

Remote Hourly · $25–$45/hr

$25–$45/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 24, 2026

Posted

Open to applicants in

United States

The Work

You will test two AI agents side by side on realistic everyday errands. You will use your phone and personal accounts, guide each agent when needed, and observe how well it completes each task.

You will screen record every attempt and explain what worked, what failed, and how the experience felt. Your feedback will cover completion, quality, user control, satisfaction, and time.

  • Run scenarios involving bills, returns, email follow-ups, bookings, shopping, groceries, travel, outings, forms, and other errands.
  • Approve or stop an agent when an important action needs your control.
  • Document each interaction clearly from start to finish.
  • Score each run and provide precise written feedback about the agent experience.

What It Pays And Takes

This is remote, part-time contractor work for candidates based in the United States. You will complete the work with a smartphone, personal accounts, and the required testing tools.

  • Pay: $25 to $45 per hour.
  • Location: Open to candidates in the United States.
  • Education: Bachelor's degree required.
  • Experience: Two to three years of experience preferred, especially in engineering, business management, office, or operations work.
  • Skills: Strong attention to detail, precise instruction following, clear writing, and careful step-by-step documentation.
  • Background: You should use AI in daily life. Generalists are welcome, and no coding background is required.
  • Equipment and accounts: A smartphone that can record its screen, an active personal AI assistant account on the Plus tier, and active access to the required testing tools.
  • Testing purchases: A payment card is required, and test purchases are reimbursed afterward.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind artificial intelligence. People test systems, review their outputs, and explain what needs to improve so AI tools work better in real situations.

Requirements

  • Experience: Entry level
  • Languages: English

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

Ready to apply?

Create a free OpenTrain account and apply for this role in minutes.

Keep exploring

Similar open roles

View all AI training jobs

AI Training QA Team Lead (Gujarati, Mathematics)

Review Gujarati AI content, assess trainer and reviewer work, and guide quality standards for $30 per hour. This remote contractor role requires mathematics education, Gujarati and English fluency, and three years of relevant experience.

Generative AI & RLHF
Text
Remote · India, United Kingdom, United States
Gujarati, English
Part-time · Flexible
Entry level
Hourly · $30/hr

Posted Oct 25, 2026

Political Science AI Evaluation Expert

Evaluate AI-generated political content for analytical quality, rigor, and evidence-based reasoning. This part-time U.S. contract offers up to $75 per hour and requires 20+ hours per week.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level
Hourly · $75/hr

Posted Oct 24, 2026

Economics AI Content Evaluation Expert

Evaluate AI-generated economics content for formal accuracy, rigor, and relevance at $75 per hour. Use your economics research expertise in a flexible, 20-plus-hour weekly contract role open to candidates in the United States.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level
Hourly · $75/hr

Posted Oct 24, 2026

HR Workflow Benchmark Design Expert

Design realistic AI benchmark tasks based on payroll, workforce planning, HR policies, and employee lifecycle work. Earn $45 to $90 per hour with less than 20 hours per week.

Generative AI & RLHF
Document
Remote · United Arab Emirates, Argentina, Austria +48 more
English
Part-time · Flexible
Entry level
Hourly · $45–$90/hr

Posted Oct 24, 2026

Business Operations AI Task Design Expert

Use business operations expertise to review AI model outputs, apply clear rubrics, and explain your judgments. This remote contract role pays $45 to $90 per hour and typically requires less than 20 hours per week.

Generative AI & RLHF
Document
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Entry level
Hourly · $45–$90/hr

Posted Oct 24, 2026