Skip to content
OpenTrain AIFor AI Companies

AI Agent Tester

Apply now

Job details

Pay

$25–$45 USD/hr

Engagement

Contract, part-time

Location

Remote

12 countries

Posted

Nov 16, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting an AI Agent Tester to evaluate how well AI agents handle realistic everyday tasks. You will use your smartphone to record agent interactions, score their performance, and provide clear written feedback that helps improve next-generation AI systems. This is a remote contractor opportunity for contributors based in Europe, with flexible scheduling and pay of $25‑$45 per hour.

What you will do
You will run real-life scenarios involving activities such as bill payments, returns, email follow-ups, bookings, shopping, travel, family logistics, outings, and forms. You will test two AI agents side by side, approve or stop them at important decision points, screen record each attempt, and score completion, quality, control issues, satisfaction, and time. You will also document what worked, what did not, and how the experience felt from a real user's perspective. Each testing run takes approximately 1.5 hours, including evidence collection and scoring.

Required skills
You should be based in Europe, have a bachelor's degree or local equivalent, and use AI tools in daily life. Two to three years of experience in engineering, business management, office work, or operations is preferred. You must be detail-oriented, able to follow instructions and document each step accurately, and able to communicate clearly in writing. You should have access to a personal AI account and a smartphone capable of screen recording. No coding or prior AI background is required.
You have a debit or credit card of your own for test purchases, such as groceries or a booked service. You buy first, and the hiring company reimburses you afterward.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

Requirements

  • Languages: English
  • Skills: ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen Recording, Dots, Mobile

Open to applicants in

  • Austria
  • Belgium
  • Denmark
  • France
  • Germany
  • Greece
  • Italy
  • Netherlands
  • Portugal
  • Spain
  • Switzerland
  • United Kingdom

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmwjfwywd002x08i3h0sbtds6

Keep exploring

Similar open roles

View all AI training jobs

Applied AI Agent Evaluation Research Engineer

About OpenTrain. OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and develop a durable freelance career. We help ca…

AI Agent Evaluation & Benchmark DesignPython & Research EngineeringAgent Failure Analysis & ExperimentationLLM & Agentic Systems
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $96.15–$125/hr

Posted Nov 17, 2026

AI Product Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

AI ModelsAI AgentsFollowing InstructionsAttention to Detail
Text
Remote · United Kingdom, India, Japan
English
Part-time · Flexible
Hourly · $14–$36/hr

Posted Oct 16, 2026

Python Coding-Agent Benchmark Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Python
Code
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 18, 2026

Python Domain Expert - Coding Agent Benchmarking

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Python
Code
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 18, 2026

AI Agent Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Video
Remote · United States
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026