Physics LLM Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We connect contributors with opportunities to teach and evaluate AI, build a professional profile, and grow a lasting portfolio of work in this rapidly expanding field.

About AI Training and LLM Evaluation

AI training is the human side of building artificial intelligence. People create examples, review model outputs, and provide feedback that helps modern systems reason more accurately and communicate more clearly. In this role, your physics expertise will directly support the evaluation and improvement of large language models.

• Work on cutting-edge AI evaluation from anywhere in the world
• Use advanced subject-matter knowledge to reveal model reasoning limitations
• Build experience in a fast-growing area of technical AI work

The Role

OpenTrain is seeking a Physics LLM Evaluation Expert to create and solve demanding physics problems used to fine-tune and evaluate large language models. You will turn complex reasoning into clear, rigorous solutions, help researchers investigate model limitations, and contribute to evaluation benchmarks spanning early undergraduate through PhD-level physics.

The work may include abstraction, multi-step reasoning, symbolic manipulation, astrophysics, cosmology, nuclear physics, and particle physics.

• Fully remote contractor assignment
• Part-time schedule of 20+ hours per week
• Worldwide opportunity for individual freelancers
• English-language work

What You'll Do

You will combine physics problem solving with structured evaluation and technical communication. Your work will help researchers understand where language models struggle and provide the high-quality examples and feedback needed to improve them.

• Design challenging physics problems that expose weaknesses in large language model reasoning
• Solve problems and write accurate, step-by-step explanations with structured logic
• Collaborate with LLM researchers to align problem sets with evaluation objectives
• Provide constructive feedback and detailed annotations that support model improvement
• Help define physics evaluation benchmarks across undergraduate and advanced academic curricula
• Explain difficult concepts using simple language, visual reasoning, and sound physics principles
• Identify weaknesses in abstraction, multi-step reasoning, and symbolic manipulation

Requirements

You should have a strong physics foundation at the level of advanced academic study, together with the analytical and research skills needed to solve complex problems. Clear technical communication, creative and lateral thinking, and the ability to work independently are important for success.

Strong English comprehension and access to a desktop or laptop with a reliable internet connection are required.

• Currently pursuing a Master's, Ph.D., or postdoctoral degree in Physics, Applied Physics, or a related field
• Strong analytical and research skills for solving complex physics problems
• Ability to explain physics concepts clearly through structured reasoning, simple language, and visuals
• Ability to provide constructive feedback and detailed annotations
• Ability to identify weaknesses in abstraction, multi-step reasoning, and symbolic manipulation
• Effective collaboration in a remote setting
• Reliable desktop or laptop and internet connection

Relevant Physics Backgrounds

Experience or academic focus in astrophysics and cosmology, or in nuclear and particle physics, is relevant to this opportunity. The broader work may span multiple levels of physics, from early undergraduate material through PhD-level concepts.

Build Your AI Training Portfolio

OpenTrain gives contributors a place to develop a professional history in AI training and data labeling. As you complete specialized evaluation work, you can strengthen your profile, demonstrate credible experience, and discover opportunities aligned with your expertise.

• Create an OpenTrain account for free
• Showcase your AI training experience in one profile
• Find opportunities that match your technical background
• Grow toward a durable freelance career in AI training