Sports Domain AI Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. It helps people discover opportunities, build a professional profile, and grow their experience in a rapidly expanding field where human expertise shapes how artificial intelligence works.

• Create an OpenTrain account for free.
• Find remote opportunities across AI training and data labeling.
• Build experience contributing to cutting-edge AI systems.

About AI Evaluation Work

AI training is the human side of building artificial intelligence. Experts write prompts, review model responses, identify errors, and provide feedback that helps large language models become more accurate, reliable, and useful.

• Work remotely with a computer and internet connection.
• Apply specialized knowledge to real AI model development.
• Help shape how AI handles complex sports information and reasoning.

The Role

OpenTrain AI is seeking a Sports Domain AI Evaluation Expert to design challenging prompts and assess AI-generated responses about global sports. This contractor assignment focuses on evaluating factual accuracy, reasoning quality, completeness, and nuance across leagues, athletes, tournaments, rules, statistics, and analytics.

The role is an 8-week contractor assignment with a commitment of 40 hours per week and at least four hours of overlap with Pacific Standard Time. The position is classified as part-time contractor work in the supplied role details and does not include medical or paid leave.

• Contractor assignment
• 8-week duration
• 40 hours per week
• At least 4 hours of PST overlap
• No medical or paid leave

What You'll Do

You will apply deep sports knowledge and careful research to create evaluation materials and review model-generated content. Your evidence-based feedback will help AI researchers identify weaknesses and improve model performance.

• Create advanced prompts covering global sports, leagues, athletes, tournaments, rules, statistics, and analytics.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback supported by reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation quality and clear documentation.

Required Qualifications

This role requires strong subject-matter expertise in sports and the ability to assess sports-related information with precision. Candidates should be comfortable researching claims, recognizing subtle inaccuracies, and explaining their evaluations in clear written English.

• Master’s degree or higher in any field; Sports Management, Sports Science, Journalism, Communications, Media Studies, or a related discipline is preferred.
• Strong knowledge of global sports, including major leagues, teams, athletes, tournaments, rules, statistics, and key developments across one or more sports.
• At least 3 years of relevant professional experience, preferably in sports journalism, sports media, sports content, research, analysis, reporting, or a related field.
• Excellent written English, research, and analytical skills.
• Strong attention to detail and the ability to assess sports-related information accurately.
• English-language work.

Helpful Background

Experience working with AI systems can help you contribute more effectively, although the central qualification for this role is demonstrated sports expertise and the ability to produce objective, well-supported evaluations.

• Experience with large language models, generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience.
• Ability to work independently and provide objective, evidence-backed reviews.

Schedule And Assignment Details

This role offers a structured contractor engagement focused on sports-domain AI evaluation. The required schedule is 40 hours per week, including at least four hours of PST overlap, for the full 8-week assignment.

• Employment type: Contractor
• Work arrangement: Part-time
• Time requirement: 20+ hours per week in the supplied opportunity details; the role description specifies 40 hours per week.
• Language: English
• Location: Worldwide