Political Science AI Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI recruits contributors for projects that help shape how modern artificial intelligence understands information, reasons through complex questions, and responds to people.

Creating an OpenTrain account is free, and contributors can build a profile and apply to AI-training opportunities in minutes.

About AI Evaluation Work

AI training is the human side of building artificial intelligence. Expert contributors write prompts, review model responses, identify errors, and provide evidence-based feedback that helps AI systems become more accurate, useful, and reliable.

This project focuses on high-stakes political topics, where careful reasoning, current knowledge, and attention to factual nuance are especially important.

The Role

OpenTrain AI is seeking a Political Science AI Evaluation Expert to design prompts and evaluate large language model responses across political science, governance, elections, public policy, and international relations. This is a remote contractor assignment focused on improving model accuracy and reasoning in political domains.

The role requires objective judgment, strong research skills, and the ability to assess political information accurately across a wide range of subjects.

• Contractor assignment with no medical or paid leave
• Eight-week contract duration
• 40 hours per week with at least four hours of PST overlap
• The opportunity is listed as requiring 20+ hours per week
• Worldwide remote opportunity
• English-language work

What You'll Do

You will help create and assess text-based training data for generative AI systems. Your reviews should be rigorous, well documented, and supported by reliable references when evaluating factual claims.

• Create advanced prompts covering political science, governance, elections, public policy, and international relations
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases
• Develop benchmark datasets and adversarial test cases
• Provide evidence-based feedback with reliable references
• Collaborate with AI researchers to improve model performance
• Maintain high annotation quality and clear documentation

Requirements

Applicants should have advanced academic preparation and relevant professional experience in political or closely related fields. The position specifically calls for a master's degree or higher and at least three years of relevant experience.

• Master's degree or higher; political science, public policy, international relations, government, public administration, law, economics, journalism, or another politics-related discipline is preferred
• Strong knowledge of political systems, governance, elections, public policy, international relations, political institutions, comparative politics, and current global political developments
• At least three years of relevant professional experience, preferably in public policy, government, political research, political consulting, academia, journalism, international affairs, think tanks, or a related field
• Excellent written English, research, and analytical skills
• Strong attention to detail and the ability to identify factual inconsistencies and assess reasoning across political and public policy topics
• Ability to work independently and provide objective, evidence-backed reviews

Helpful Background

Experience working with large language models or generative AI is helpful but preferred rather than required. Research, teaching, or recognized work in the field can also strengthen an application.

• Experience with LLMs, generative AI, prompt engineering, or AI evaluation
• Published research
• Industry recognition
• Teaching experience

Why Join AI Training

AI training is a rapidly growing area of technology work, and specialists play a direct role in shaping how state-of-the-art models behave. Political science experts can apply their knowledge to challenging evaluation tasks while contributing to the development of more reliable AI systems.

• Remote work from anywhere with a computer and internet connection
• Direct involvement in cutting-edge AI development
• A way to apply political research and analytical expertise to practical technology projects
• The opportunity to build experience in a fast-growing AI training field