Physics Reasoning Evaluator

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping people discover opportunities to teach and improve cutting-edge artificial intelligence.

• Remote opportunity available worldwide
• Part-time contractor engagement
• Compensation of $80 USD per hour
• Applications are completed through OpenTrain

About AI Training Work

AI training is the human side of building modern artificial intelligence. Specialists review model outputs, assess whether reasoning is accurate and useful, and create high-quality examples that help AI systems improve.

In this role, your physics knowledge will directly shape how AI models solve advanced technical problems and explain their reasoning.

• Work remotely with a flexible part-time schedule
• Contribute to the development of advanced AI systems
• Apply specialized subject-matter expertise to model evaluation

The Role

OpenTrain is seeking a Physics Reasoning Evaluator to assess AI-generated physics responses. This role is designed for physics specialists rather than generalists and requires a BS, MS, or PhD in Physics or a closely related physics discipline from a top-100 university.

You will evaluate both the final answer and the reasoning behind it, checking conceptual accuracy, mathematical methodology, computational details, units, assumptions, and clarity.

• Role type: Part-time contractor
• Experience level: Entry level
• Subject matter: Advanced physics reasoning and assessment
• Language: English
• Availability: Minimum 17–20 hours per week
• Preferred active-sprint cadence: Approximately 8 hours per day

What You’ll Do

You will review and compare multiple AI-generated responses using detailed evaluation rubrics. Your work will combine rigorous physics analysis, scientific writing, fact-checking, and consistent judgment.

• Review AI-generated responses to physics problems
• Judge correctness, reasoning depth, and clarity
• Identify errors in derivations, assumptions, units, and methodology
• Fact-check physics claims using reputable public sources
• Author exemplar solutions and explanations for model training
• Rate and compare multiple responses against detailed rubrics
• Provide precise references when needed

Required Qualifications

You must hold or be pursuing a BS, MS, or PhD in Physics or a closely related physics field from a top-100 university. You should have broad mastery of core physics and the ability to produce clear, rigorous, step-by-step explanations in C1+ English.

• Strong foundation in classical mechanics, electromagnetism, thermodynamics, quantum mechanics, and statistical physics
• Strong quantitative reasoning, including dimensional analysis and unit consistency
• Awareness of uncertainty, approximations, and methodological assumptions
• Excellent scientific writing with correct notation
• Ability to follow detailed evaluation rubrics consistently
• High attention to detail
• Clear written English at C1 level or above
• LaTeX proficiency preferred
• Familiarity with special or general relativity is a plus

Preferred Background

The strongest candidates may also bring experience that supports careful analysis and communication. These qualifications are preferred or additional rather than replacements for the required physics background.

• Physics research experience
• Analytical writing or debate experience
• Programming literacy, such as Python or Matlab
• Experience with data labeling, RLHF, or AI model evaluation

Paid Qualification and Project Exams

Onboarding includes a paid qualification exam lasting approximately 1–2 hours and a paid project exam lasting approximately 1–2 hours. These assessments help establish readiness for the evaluation work.

• Paid qualification exam: approximately 1–2 hours
• Paid project exam: approximately 1–2 hours

How This Work Fits Your Career

AI training is a rapidly growing field where people help shape how state-of-the-art models reason, communicate, and solve problems. This opportunity lets you apply advanced physics expertise to meaningful technical work while working remotely on a part-time schedule.

• Use your academic physics expertise in an emerging technology field
• Work from anywhere with a computer and internet connection
• Build experience in AI evaluation and human feedback
• Apply through OpenTrain to get started