Philosophy Quality Assurance Lead

About OpenTrain AI

OpenTrain AI is the centralized platform where people build careers in AI training and data labeling. We hire and contract contributors directly to work on cutting-edge projects that shape how AI systems reason, write, and explain ideas.

• OpenTrain contributors do flexible, remote work that builds a lasting portfolio in AI training.
• Creating an OpenTrain account is free and connects you to ongoing, specialized projects.

Why AI training work matters

AI training (data labeling, annotation, and human feedback) is the human side of building modern AI. Philosophical judgment and clear argument analysis are essential when models generate explanations, ethical reasoning, or analyses of conceptual problems. Your work will directly influence model behavior and quality across philosophy-focused workflows.

• Contributors influence how AI systems handle complex reasoning, ethics, and conceptual clarity.
• Many projects offer flexible schedules and entry points for experienced academics and practitioners.

The role

As a Philosophy Quality Assurance Lead you will review AI-generated philosophy content and trainer QA work for conceptual accuracy, logical validity, argument structure, clarity, nuance, formatting, and rubric adherence. OpenTrain AI is hiring this role as a remote contractor focused on quality monitoring, written feedback, documentation, onboarding support, and maintaining consistent philosophy-focused training workflows across distributed teams.

• Role type: Contractor, Part-time.
• Location: Remote, United States only.
• Time commitment: 20+ hours per week.

What you'll do

You will evaluate outputs and trainer reviews against detailed project guidelines, give clear written feedback, maintain documentation and style guidance, and help keep reviewers calibrated. Tasks focus on philosophy explanations, argument analysis, ethical reasoning, summaries of philosophers, logic problems, and conceptual comparisons.

• Review AI-generated philosophy content and trainer QA work against project rubrics and quality standards.
• Evaluate conceptual accuracy, argument structure, logical validity, philosophical context, and interpretation quality.
• Provide concise written feedback, flag recurring issues, and escalate critical problems.
• Create and maintain style guides, FAQs, calibration tasks, examples, trackers, and onboarding materials.
• Communicate updates to trainers and QAs and support process improvements across projects.

Requirements

We require a strong background in philosophy and clear written communication. Preserve exact standards: degree-level background, documented experience, and the ability to evaluate against rubrics are mandatory.

• Degree in Philosophy, Ethics, Logic, Political Theory, Humanities, Religious Studies, Classics, Cognitive Science, or a closely related field.
• 3+ years experience in philosophy research, teaching, writing, editing, academic review, ethics review, logic instruction, or related humanities workflows.
• Strong English writing skills for clear, actionable feedback and team coordination.
• Deep knowledge of philosophical methods: logic, argument analysis, ethics, epistemology, metaphysics, philosophy of mind, and conceptual clarification.
• Ability to identify strawman arguments, invalid inference, conceptual confusion, oversimplification, unsupported claims, false equivalence, and misrepresentation.
• Experience reviewing philosophical or academic writing against rubrics.
• Familiarity with AI training, LLM evaluation, or rubric-based QA workflows is a strong plus.

Helpful background and tools

The following backgrounds and tooling comfort will help you succeed but are not strict requirements if you meet the core skills above.

• Familiarity with formal logic, analytic and continental traditions, moral and political philosophy, ancient philosophy, philosophy of science, or AI ethics.
• Experience supporting remote teams of researchers, writers, reviewers, educators, annotators, or QAs.
• Comfort using Discord, Google Sheets, Google Docs, trackers, dashboards, and common project management systems.

Compensation, schedule & technical details

This is a US-only remote contractor position at $65.00 USD per hour. Expect to work 20+ hours per week on an ongoing, part-time basis. Work centers on text evaluation tasks (RLHF, evaluation/rating) and requires careful written feedback and rubric-based judgments.

• Pay: $65/hr (hourly, USD).
• Employment: Contractor, Part-time.
• Data type: TEXT. Label types: EVALUATION_RATING, RLHF.
• Language: English required.

How to apply

Apply through your OpenTrain AI profile. If you do not yet have an OpenTrain account, creating one is free and will let you submit your application and any supporting materials. Applications should highlight your philosophy background, examples of rubric-based review or academic feedback, and availability for 20+ hours/week.

• Submit a resume/CV and brief examples of relevant philosophy review, teaching, or editorial work.
• Describe any prior experience with AI training, LLM evaluation, or rubric-based QA (if applicable).
• Be prepared for a brief calibration exercise to demonstrate evaluation and feedback style.