Physics Problem Designer for LLM Evaluation

About OpenTrain

OpenTrain AI is the #1 platform for finding and building careers in AI training and data labeling. We connect skilled contributors with projects that help shape modern artificial intelligence, while making it easy to build experience in this fast-growing field.

Creating an OpenTrain account is free, and candidates can apply in minutes for remote opportunities that match their expertise. For this role, OpenTrain AI is recruiting contractors to contribute specialized physics knowledge to LLM evaluation projects.

About AI Training and LLM Evaluation

Large language models improve through examples and expert feedback. In this role, your physics problems, solutions, and evaluations will help test whether an AI system can reason accurately across challenging academic topics.

AI training work is often remote and flexible, allowing contributors to work around studies, research, or other commitments. It is also a direct opportunity to influence how cutting-edge AI systems understand and explain complex ideas.

The Role

OpenTrain AI is seeking a Physics Problem Designer for LLM Evaluation. You will combine deep physics knowledge with structured AI evaluation work by creating and solving complex problems that probe the reasoning limits of large language models.

The evaluation scope may span physics curricula from early undergraduate through PhD-level topics. This is an entry-level contract and part-time opportunity requiring a commitment of 20+ hours per week, with work available remotely worldwide.

• Employment type: Contractor and part time
• Time requirement: 20+ hours per week
• Work arrangement: Remote, worldwide
• Primary language: English
• Data focus: Text generation and evaluation rating

What You’ll Do

You will create rigorous physics content and communicate the reasoning behind each solution clearly. You will also work with LLM researchers to connect individual problems to broader model evaluation goals and help develop meaningful benchmarks.

• Design challenging physics problems that test large language model reasoning
• Solve problems and provide clear, step-by-step solutions
• Explain analytical reasoning in a structured, well-articulated way
• Collaborate with LLM researchers on evaluation objectives
• Help define new benchmarks based on physics curricula from early undergraduate to PhD level

Requirements

Applicants should have a solid foundation in physics at the level of engineering entrance exams, graduate programs, or PhD-level study. Strong analytical and research skills are essential, as is the ability to communicate in a structured way while working independently in a remote setting.

• Solid physics foundation at engineering entrance exam, graduate, or PhD level
• Strong analytical and research skills
• Excellent structured communication
• Ability to work independently in a remote environment
• Desktop or laptop with a good internet connection
• Ability to work in English

Helpful Background

This role may be a strong fit for people currently pursuing advanced academic work or research in physics. Candidates who can make difficult concepts accessible through simple language, visuals, and physics-based reasoning may be especially well suited.

• Master’s, PhD, or postdoctoral study in Physics, Applied Physics, or a related field
• Experience explaining physics concepts clearly
• Ability to use simple language, visuals, and physics reasoning to support explanations

Why Join AI Training Work

AI training and data annotation are the human side of building artificial intelligence. Contributors prepare examples, write content, and evaluate model outputs so that AI systems can become more accurate, capable, and useful.

This remote field offers flexible part-time work and the chance to apply specialist knowledge to state-of-the-art technology. Your physics expertise can help establish stronger standards for how AI reasons about technical problems.

• Work remotely from anywhere in the world
• Build experience in a fast-growing AI training field
• Apply advanced physics knowledge to practical model evaluation
• Contribute to the development of new physics reasoning benchmarks

How to Apply Through OpenTrain

Create a free OpenTrain account and apply in minutes. Include your relevant physics background, academic or research experience, and examples of how you explain complex concepts clearly.

• Review the role requirements and confirm your 20+ hour weekly availability
• Create or update your OpenTrain profile
• Highlight your physics education, research, and communication strengths
• Apply through OpenTrain AI for consideration