Skip to content
OpenTrain AIFor AI Companies

Gmail & Google Calendar AI Assistant Evaluator

Apply now

Job details

Pay

$15–$30 USD/hr

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Sep 26, 2026

OpenTrain on Trustpilot

The work

You will test AI assistants using everyday email, calendar, booking, scheduling, and coordination tasks. You will check whether each assistant completes the task accurately and fully, then record your findings.

The work includes giving clear instructions, grading and ranking responses, adding annotations, and submitting structured evaluation data. You may also identify unusual cases, discuss unclear examples with other contributors and trainers, and use feedback during quality reviews.

  • Complete repeatable tasks involving Gmail messages, email threads, calendar invitations, bookings, scheduling, and multi-person coordination.
  • Check AI-generated work for accuracy, completeness, and adherence to evaluation guidelines.
  • Grade, rank, and annotate assistant responses using structured AI training tools.
  • Record findings and submit evaluation data.
  • Identify edge cases and resolve unclear examples with contributors and trainers.

Requirements

This is a remote contractor role with part-time employment. Candidates must be based in the United States and fluent in English.

  • Language: Fluent in English.
  • Experience: Daily hands-on experience with Gmail and Google Calendar, including sending messages, accepting invitations, scheduling, and changing plans.
  • Coordination: Experience working with others by email or text and booking restaurants, appointments, travel, deliveries, or similar services.
  • Devices and accounts: An iPhone with iMessage and an active Facebook or Instagram account.
  • Skills: Clear written communication, careful attention to detail, time management, self-organization, and comfort instructing AI tools and checking their work.
  • Skills: Gmail, Google Calendar, AI Usage, Scheduling, Emails, Google Meetings

Open to applicants in

  • United States

Preferred

  • Helpful experience: AI evaluation, data labeling, user testing, prompt writing, or reviewing model outputs for accuracy, helpfulness, and safety.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form. It asks for your resume again, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.
  3. Take a short AI interview.

OpenTrain on Trustpilot

Job ID: cmui6fowy00000bgmk6fwt0j9

Keep exploring

Similar open roles

View all AI training jobs

Trade Compliance Expert AI Evaluator

Use trade compliance expertise to create expert tasks, assess AI-generated answers, and give clear feedback on reporting, export controls, sanctions, and audits. This ongoing remote role pays up to $80 per hour with no set schedule.

Generative AI & RLHF
Text
Remote · United States
English
Flexible hours
Hourly · $80/hr

Posted Nov 16, 2026

Hardware Expert AI Training Specialist

Create, solve, and evaluate rigorous hardware engineering problems for AI training from anywhere, with a flexible commitment of about 15 hours per week. Pay is $60 to $120 per hour equivalent, paid per task that meets the project specifications.

RTLHardware
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

STEM Expert for AI Problem Evaluation

Solve scientific and technical problems, use Python for calculations or simulations, and review AI-generated answers for accuracy. This flexible role offers approximately 15 hours per week and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Biology
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

AI Agent Evaluator

Test AI agents on realistic smartphone tasks such as bookings, shopping, payments, and forms. Earn $25 to $45 per hour on a flexible schedule, with each run taking about 1.5 hours.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United States
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026

AI Agent Tester

Test two AI agents on realistic tasks such as bookings, shopping, forms, and follow-ups. Record each attempt, score performance, and write clear feedback from a real user’s perspective.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026