Political Science Quality Assurance Lead

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling — where people start and grow careers teaching AI. We help contributors discover projects, build a lasting portfolio of AI training work, and access flexible, remote opportunities.

OpenTrain AI is the hiring and contracting organization for this role.

About the role

We are hiring a Political Science Quality Assurance Lead to oversee quality, consistency, and trainer performance across political science AI training projects. You will review AI-generated explanations, comparative analyses, policy summaries, political theory discussions, institutional descriptions, and QA work from trainers and reviewers.

This is a part-time, remote contractor role for candidates based in the United States. Scheduling is flexible and OpenTrain will match you to project assignments as they arise.

What you'll do

• Evaluate submissions against detailed project rubrics for conceptual accuracy, institutional knowledge, and policy reasoning.
• Assess clarity, formatting, instruction-following, and comparative context in political science content.
• Identify recurring quality issues, spot bias or unsupported claims, and escalate critical problems.
• Provide precise written feedback and calibration notes to trainers and QAs to improve consistency.
• Maintain and update style guides, FAQs, onboarding materials, calibration tasks, examples, and trackers.
• Answer contributor questions on political theory, comparative politics, public policy, international relations, and rubric interpretation.
• Support onboarding and ongoing training for remote contributors and help identify inactive contributors for follow-up.
• Propose workflow improvements to scale political science QA processes and maintain documentation.

Minimum requirements

Candidates must demonstrate strong domain knowledge and clear written English communication. You will be judging political analysis for accuracy, bias, and rubric adherence, so subject expertise and the ability to explain issues concisely are essential.

• Strong background in Political Science, International Relations, Public Policy, Government, Political Theory, Security Studies, Law, Sociology, Economics, or a closely related field.
• Excellent written English for clear, actionable feedback to trainers and reviewers.
• Ability to evaluate work against detailed rubrics and to explain quality issues precisely.
• Familiarity with institutions, comparative politics, governance, state capacity, civil society, and political behavior.
• Comfort using remote collaboration tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Prior political science research, teaching, policy analysis, academic review, fact-checking, or rubric-based review is a strong plus.
• Experience with AI training, annotation, LLM evaluation, or policy QA is highly relevant.

Helpful background

You will stand out if you have experience leading or supporting remote teams of analysts, researchers, reviewers, educators, annotators, or QAs, and if you bring familiarity with areas like electoral politics, political economy, constitutional systems, conflict studies, or policy evaluation.

• Experience with democracy vs. authoritarianism research, international organizations, public administration, or survey research.
• Prior roles that involved calibration, QA leadership, or documentation for distributed contributor teams.

Location, schedule, pay, and next steps

This role is open to contractors located in the United States. It is part-time with flexible scheduling and requires at least 20 hours per week. OpenTrain will assign projects and coordinate onboarding.

Pay is up to $70/hour depending on project assignment. OpenTrain will provide the project rubric, onboarding materials, and access to collaboration tools.

To apply, create or update your OpenTrain profile, highlight relevant political science experience, and indicate your availability for 20+ hours/week. Selected candidates will complete calibration tasks and onboarding before starting live reviews.