Film And Television AI Evaluation Expert

You will help improve AI systems by testing what they know about film, television, streaming, and entertainment history. You will create difficult questions, compare AI answers, and explain which responses are accurate, incomplete, outdated, or misleading.

Your work will support benchmark datasets, which are collections of test examples used to measure AI quality. You will also create adversarial test cases designed to reveal weaknesses, and work with AI researchers to identify gaps in the models' knowledge.

• Create advanced prompts about films, television series, actors, directors, genres, awards, franchises, streaming platforms, and entertainment history.
• Rate AI-generated responses for factual accuracy, reasoning, completeness, and nuance.
• Find hallucinations, logical inconsistencies, outdated information, and edge cases.
• Compare multiple AI responses and explain why each answer is correct or incorrect.
• Provide evidence-based feedback with reliable references and suggest improved prompts.
• Develop benchmark datasets and adversarial tests for AI evaluation.

What It Pays And Takes

The role is structured as contract, part-time work. It is open to candidates in the United States and requires at least 20 hours per week.

• Location: Open to candidates in the United States.
• Time: 20 or more hours per week.
• Work type: Contract and part-time.
• Education: A master's degree or higher is required. Film Studies, Television Studies, Media Studies, Journalism, or a related field is preferred.
• Experience: At least three years in entertainment journalism, film or television criticism, entertainment media, content creation, research, or analysis.
• Knowledge: Strong knowledge of movies and television, including films, series, actors, directors, genres, franchises, awards, streaming platforms, and major developments.
• Skills: Excellent written English, research, analysis, and attention to detail.
• Helpful background: Experience with large language models, generative AI, prompt engineering, or AI evaluation; published research, industry recognition, or teaching experience; and the ability to work independently and provide objective, evidence-backed reviews.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that generate and understand text. People write examples, review model answers, and explain what makes a response useful and accurate, helping AI systems improve.