Skip to content
OpenTrain AIFor AI Companies

Everyday AI Agent Experience Tester

Evaluate two AI agents as they handle everyday tasks such as bookings, shopping, payments, and email. Record each attempt, score the experience, and provide written feedback for $25 to $45 per hour.

Apply now
OpenTrain AI

Generative AI & RLHF

Remote Hourly · $25–$45/hr

$25–$45/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 9, 2026

Posted

Open to applicants in

United States

The Work

You will test two AI agents side by side on a smartphone while they handle realistic everyday errands. You will use personal accounts, supervise important actions, and document what happens during each attempt.

Scenarios may include bill payments, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.

  • Run realistic everyday scenarios with two AI agents.
  • Approve or stop agent actions at important points.
  • Screen record every attempt and preserve interaction evidence.
  • Score completion, quality, control issues, satisfaction, and time.
  • Write clear feedback about what worked, what failed, and how the experience felt.

What It Pays And Takes

This is a remote contractor role for candidates based in the United States. You will work from a smartphone on your own schedule, with each run taking about 1.5 hours, including evidence collection and scoring.

  • Pay: $25 to $45 per hour.
  • Location: Open to candidates in the United States.
  • Work arrangement: Remote, part-time contract work.
  • Language: Fluent English for written feedback and documentation.
  • Education: Bachelor's degree required.
  • Experience: Two to three years preferred, especially in engineering, business management, office work, or operations.
  • Regular experience using AI tools in daily life.
  • Strong attention to detail and careful instruction following.
  • Thorough step-by-step documentation and clear written communication.
  • A smartphone with screen-recording capability.
  • Access to the personal AI accounts needed for assignments.
  • No coding or prior AI background is required. Generalists are welcome.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training work is the human side of building artificial intelligence. People test systems, review their results, and provide examples or feedback that help AI tools become more useful, accurate, and easier to control.

Requirements

  • Experience: Entry level
  • Languages: English

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

Ready to apply?

Create a free OpenTrain account and apply for this role in minutes.

Keep exploring

Similar open roles

View all AI training jobs

English-Speaking Financial AI Evaluation Expert

Evaluate AI agents on finance and business workflows by writing prompts, reviewing responses, and creating structured feedback. This remote part-time contract pays $30 to $40 per hour and requires professional finance experience plus strong Microsoft 365 skills.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +50 more
English
Part-time · Flexible
Entry level
Hourly · $30–$40/hr

Posted Oct 10, 2026

Rates Trading Strategy AI Evaluator

Evaluate AI-generated rates trading strategies using professional judgment on swaps, swaptions, Treasury futures, SOFR products, and repo. This remote contractor role pays $80 to $100 per hour and suits experienced rates professionals.

Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +50 more
English
Part-time · Flexible
Entry level
Hourly · $80–$100/hr

Posted Oct 10, 2026

Finance AI Model Evaluation Expert

Evaluate AI model responses on finance topics, create scoring rubrics, and guide better training decisions. This remote US contract pays $100 per hour and offers flexible work for finance professionals.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level
Hourly · $100/hr

Posted Oct 8, 2026

Business Data AI Evaluation Analyst

Review business datasets and AI analysis outputs for accuracy, privacy, and quality in a part-time remote contractor role open to the United States. Pay is $50 to $80 per hour.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level
Hourly · $50–$80/hr

Posted Oct 8, 2026

English-Speaking AI Evaluator

Review AI assistant responses to realistic education scenarios, including student communication, scheduling, and classroom coordination. This part-time contract role pays $15 to $40 per hour and is open to candidates in the United States.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level
Hourly · $15–$40/hr

Posted Oct 8, 2026