Personalized AI Response Evaluator

As a Personalized AI Response Evaluator, you will review AI-generated answers that use information from connected Google applications. You will judge whether each response is relevant, accurate, helpful, and appropriately personalized.

You will also compare multiple answers, find unsupported assumptions or irrelevant recommendations, and write clear feedback that helps improve AI systems. You must follow project guidelines and keep connected account information confidential.

• Evaluate personalized prompts and AI-generated responses.
• Review context retrieved from Google Gmail, Google Photos, Google Calendar, or Google Drive.
• Assess response quality, relevance, accuracy, helpfulness, and personalization.
• Identify subtle inconsistencies, unsupported assumptions, and irrelevant recommendations.
• Compare alternative responses and select the stronger user experience.
• Write detailed, structured evaluation feedback.

What it pays and takes

This is a part-time contractor opportunity for up to 16 weeks. The listing does not provide a pay rate.

• Location: You must currently live in the United States.
• Language: English.
• Hours: At least four hours per day and up to 40 hours per week, with at least four hours of overlap with Pacific Time.
• Availability: The structured listing indicates a commitment of 20 or more hours per week.
• Education: A bachelor's degree or equivalent practical experience in any field.
• Account access: Active use of Google Workspace or consumer Google applications with enough personal or business account history for retrieval evaluations.
• Equipment: A desktop or laptop with a reliable internet connection.
• Other requirements: Strong analytical thinking, close attention to detail, excellent written communication, independent work skills, and willingness to connect relevant Google applications.
• Helpful experience: AI evaluation, data annotation, content review, quality assurance, or another analytical role. This experience is useful but not required.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human side of building artificial intelligence. Evaluators review model responses and provide examples or feedback so AI systems can become more accurate, useful, and consistent.