About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Political Science LLM Evaluation Expert to help evaluate and improve large language models. You will apply knowledge of political systems, governance, elections, public policy, international relations, and related fields to create demanding evaluation material and assess whether model responses are accurate, well-reasoned, complete, nuanced, and current. The role combines political research judgment with hands-on AI training work, including benchmark development, adversarial testing, annotation quality, and evidence-backed feedback.
What you will do
Create advanced prompts covering political science, governance, elections, public policy, and international relations. Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance. Identify hallucinations, logical inconsistencies, outdated information, and difficult edge cases. Develop benchmark datasets and adversarial test cases, provide objective feedback supported by reliable references, collaborate with AI researchers to improve model performance, and maintain high annotation quality and clear documentation.
Required skills
A master's degree or higher in any field is required. Degrees in political science, public policy, international relations, government, public administration, law, economics, journalism, and other politics-related disciplines are preferred. Candidates should have strong knowledge of political institutions, comparative politics, governance, elections, public policy, and current global political developments. At least three years of relevant experience in political research, public policy, government, political consulting, academia, journalism, international affairs, think tanks, or a related area is expected. Excellent written English, research, analytical, and documentation skills are essential, along with strong attention to detail and the ability to identify factual inconsistencies and evaluate reasoning across varied political topics.
Helpful background
Experience with large language models, generative AI, prompt engineering, or AI evaluation is valuable. Published research, teaching experience, or industry recognition is helpful. The work suits professionals who can operate independently and produce objective, evidence-backed reviews.
Engagement details
This is a contractor assignment requiring 40 hours per week, including at least four hours of overlap with Pacific Time. The engagement is scheduled for eight weeks.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.