Senior AI Trainer for AI Model Evaluation (English)

The title identifies this as a Senior AI Trainer role, while the duties focus on AI model response evaluation. Review the duties and qualifications before applying.

You will assess AI chat and search tools, rate model responses, and provide structured feedback that helps improve model behavior. The work includes reviewing real-world outputs, identifying user intent and edge cases, and keeping evaluation standards consistent.

• Evaluate AI chat and search tools under standardized conditions.
• Rank and annotate model responses using detailed grading rubrics.
• Write, refine, and stress-test prompts across different scenarios and edge cases.
• Check that ratings match the applicable rubrics and correct discrepancies.
• Record findings and submit evaluation datasets through AI training platforms.
• Work with other trainers and contributors to resolve unclear cases and improve consistency.
• Take part in quality reviews and apply feedback to ongoing evaluation work.

This is a remote contractor role with part-time work. It is available to candidates in Germany and requires fluent English.

• $14 to $36 per hour.
• Remote contractor role.
• Part-time work.
• Fluent English.
• Intermediate experience level.
• Exceptional attention to detail when reviewing AI-generated content.
• Strong written and verbal communication for reporting findings and working remotely.
• Analytical problem-solving skills, sound judgment when guidance is unclear, and good self-organization.
• Familiarity with AI products, model behavior, and prompt engineering.