Gmail & Google Calendar AI Assistant Evaluator

You will test AI assistants using everyday email, calendar, booking, scheduling, and coordination tasks. You will check whether each assistant completes the task accurately and fully, then record your findings.

The work includes giving clear instructions, grading and ranking responses, adding annotations, and submitting structured evaluation data. You may also identify unusual cases, discuss unclear examples with other contributors and trainers, and use feedback during quality reviews.

• Complete repeatable tasks involving Gmail messages, email threads, calendar invitations, bookings, scheduling, and multi-person coordination.
• Check AI-generated work for accuracy, completeness, and adherence to evaluation guidelines.
• Grade, rank, and annotate assistant responses using structured AI training tools.
• Record findings and submit evaluation data.
• Identify edge cases and resolve unclear examples with contributors and trainers.

This is a remote contractor role with part-time employment. Candidates must be based in the United States and fluent in English.

• Language: Fluent in English.
• Experience: Daily hands-on experience with Gmail and Google Calendar, including sending messages, accepting invitations, scheduling, and changing plans.
• Coordination: Experience working with others by email or text and booking restaurants, appointments, travel, deliveries, or similar services.
• Devices and accounts: An iPhone with iMessage and an active Facebook or Instagram account.
• Skills: Clear written communication, careful attention to detail, time management, self-organization, and comfort instructing AI tools and checking their work.