Skip to content
OpenTrain AIFor AI Companies

Gmail and Google Calendar AI Assistant Evaluator

Evaluate AI assistants on realistic Gmail, Google Calendar, booking, and coordination tasks. This remote U.S. contractor role pays $15-$30 per hour and requires 20+ hours weekly.

Apply now
OpenTrain AI

Generative AI & RLHF

Remote Hourly · $15–$30/hr

$15–$30/hr

Compensation

1 country

Eligibility

Entry

Experience

Sep 26, 2026

Posted

Open to applicants in

United States

The Work

You will test how AI assistants handle everyday digital tasks involving email, calendars, bookings, and coordination. You will provide instructions, check the results, and give structured feedback on whether the assistant completed each task accurately and completely.

  • Complete realistic Gmail and Google Calendar tasks under consistent conditions.
  • Test email threads, calendar invitations, online bookings, scheduling changes, and multi-person coordination.
  • Grade, rank, and annotate assistant responses using detailed evaluation guidelines.
  • Test different scenarios and edge cases, then record findings in the required training tools and platforms.
  • Help resolve unclear evaluation cases with other contributors and take part in quality reviews.

What It Pays and Takes

This is a remote, part-time contractor role for people located in the United States. The work is listed as entry level, but you need strong hands-on experience with Gmail, Google Calendar, online bookings, and practical scheduling.

  • Pay: $15-$30 per hour.
  • Time: 20 or more hours per week.
  • Location: United States only.
  • Language: English.
  • Use Gmail and Google Calendar daily for tasks such as sending emails, managing invitations, changing plans, and coordinating with others.
  • Have independent experience booking restaurants, appointments, travel, deliveries, or similar services online.
  • Have an iPhone with iMessage and an active Facebook or Instagram account.
  • Be comfortable instructing AI tools and checking their work on real-world tasks.
  • Bring exceptional attention to detail, strong written communication, organization, and self-management for remote project work.
  • Previous AI evaluation, data labeling, user testing, prompt writing, or AI feedback work is helpful but not required.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training work uses human examples and reviews to improve how artificial intelligence systems respond. Evaluators are paid for careful judgment because their feedback helps make AI assistants more accurate, complete, and reliable.

Ready to apply?

Create a free OpenTrain account and apply for this role in minutes.

Keep exploring

Similar jobs

View all AI training jobs

Personalized AI Response Evaluator

Review AI-generated responses against real Google application context and judge their relevance, accuracy, helpfulness, and personalization. This U.S. contractor role requires at least four hours per day and up to 40 hours per week.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level

Posted Sep 15, 2026

Personalized AI Response Evaluation Rater

Review AI responses that use information from connected Google apps, checking accuracy, relevance, and personalization. This US-based contract runs up to 16 weeks and requires 20 or more hours per week.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible
Entry level

Posted Sep 4, 2026

AI Quality Analyst Gemini Personalization

Assess how Gemini uses personal context in multi-turn conversations, then compare and explain model responses. This three-month contractor role requires English, at least 20 hours per week, and four hours of PST overlap.

Generative AI & RLHF
Text
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Jul 17, 2026