Evaluate advanced AI-generated physics reasoning using expert scientific judgment, rigorous written analysis, and tools such as Python, SymPy, LaTeX, and Jupyter. This worldwide, part-time contract pays $80–$160 per hour.
Generative AI & RLHF
100% Remote Hourly · $80–$160/hr
$80–$160/hr
Compensation
Worldwide
Eligibility
Entry
Experience
Aug 3, 2026
Posted
Open worldwide
Interested in this role?
Create a free OpenTrain account and apply in minutes.
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help contributors discover specialized projects, build a credible professional profile, and grow their experience in a fast-moving field shaping how artificial intelligence is developed.
About AI Model Evaluation
AI training depends on expert human judgment. Contributors review model outputs, compare competing answers, identify errors and uncertainty, and provide the reasoning that helps AI systems become more accurate and reliable. This work offers a flexible, remote way to contribute to cutting-edge technology.
The Physics Model Evaluation Expert Role
OpenTrain is seeking a Physics Model Evaluation Expert to provide senior-level scientific judgment for training next-generation AI systems. You will assess competing physics reasoning, explain when one approach is stronger and under which assumptions, and produce defensible evaluations for review by fellow physicists.
The work centers on nuanced expert adjudication, calibrated confidence, and understanding the limits of approximations across advanced physics subfields. Prior AI experience is not required.
Subject focus: Advanced Physics Model Evaluation
Work type: Text-based evaluation and rating
Classification: Entry level in the project listing; PhD-level expertise and research leadership are required
Language: English
What You'll Do
You will evaluate technically sophisticated physics content and clearly communicate the basis for each judgment. Your analyses should distinguish established conclusions from uncertainty, unresolved questions, and open problems.
Adjudicate contested physics arguments, solutions, and interpretations within your active subfield.
Compare alternative approaches and explain their relative strengths, assumptions, applicable regimes, and breaking points.
Develop criteria for judging the robustness and validity of technical physics work.
Identify unresolved questions and distinguish established conclusions from uncertainty or open problems.
Draft rigorous written evaluations suitable for review by senior physicists.
Use LaTeX, SymPy, Python, and Jupyter as needed to verify or contrast technical claims.
Required Qualifications
This role requires demonstrated scholarly expertise in a defined, active physics research subfield. Candidates should be able to make nuanced, well-reasoned judgments and produce rigorous written evaluations for technically sophisticated readers.
PhD in physics with demonstrated expertise and scholarly impact in an active research subfield.
Current or former senior academic, principal investigator, research group leader, or equivalent research leadership experience.
Representative recent publications and experience supervising doctoral students or postdoctoral researchers.
Exceptional written communication and calibrated scientific judgment.
Ability to explain assumptions, applicable regimes, approximation limits, and the strengths or weaknesses of competing arguments.
Working proficiency with relevant tools such as LaTeX, SymPy, Python, and Jupyter.
Relevant Physics Backgrounds
Relevant expertise may come from one or more of the following areas:
High-energy physics
Mathematical physics
Biophysics
Statistical physics
Condensed matter physics
Atomic, molecular, and optical physics
Quantum optics
Gravitation
Cosmology
Astrophysics
Quantum information
Optical materials physics
Schedule, Location, and Compensation
This is a worldwide, remote contractor opportunity with a part-time schedule of fewer than 20 hours per week. You can contribute from anywhere listed as worldwide, provided you can complete the work in English.
Employment type: Contractor and part time
Time requirement: Less than 20 hours per week
Location: Worldwide and remote
Pay range: $80–$160 USD per hour
Payment type: Hourly
Build Your AI Training Career
OpenTrain gives specialists a place to discover AI training opportunities, present credible experience, and build a lasting portfolio. Your physics expertise can help shape how advanced AI systems reason about scientific questions while expanding your work in a rapidly growing area of technology.
Work on cutting-edge AI training and evaluation.
Apply your established physics expertise to meaningful technical judgments.
Work remotely with a flexible part-time commitment.
Create a profile that showcases your AI training experience over time.
Join OpenTrain AI to evaluate and improve physics-focused AI outputs—paid contract work at $80/hr, part-time (minimum ~17–20 hrs/week). Use your physics degree to spot subtle errors, write step-by-step solutions, and rate model responses with detailed rubrics.
Join OpenTrain to design and solve advanced physics problems that probe LLM reasoning and symbolic skills; remote, part-time contractor work (20+ hrs/week) for candidates with graduate-level physics experience and strong written English.
Design and solve advanced physics problems to probe large language models' multi-step reasoning and symbolic skills; remote, contract, 20+ hours/week working with OpenTrain AI to build benchmarks from undergraduate to PhD levels.