Physics Expert for LLM Evaluation

You will create and solve challenging physics problems that show where large language models struggle. Your work will support model evaluation and fine-tuning by testing abstraction, multi-step reasoning, and symbolic problem-solving.

You will work with LLM researchers to shape evaluation materials and help build physics benchmarks ranging from early undergraduate topics through PhD-level material.

• Design complex physics problems for language-model evaluation.
• Solve problems in classical mechanics, electromagnetism and optics, and thermodynamics and statistical physics.
• Write accurate, step-by-step solutions with clear reasoning.
• Give detailed annotations and constructive feedback.
• Help define physics evaluation benchmarks across undergraduate through PhD-level curricula.
• Explain advanced physics ideas in simple language, including through visuals and reasoning.
• Work independently and collaborate remotely with LLM researchers.

What it pays and takes

This is a part-time freelance contractor assignment. The listing does not specify a pay rate. The work may be extended based on performance and project needs.

• Hours: 20 or more hours per week.
• Location: Remote and open worldwide.
• Language: Excellent English comprehension and structured communication skills.
• Level: Listed as entry level, with a strong foundation in physics, applied physics, or a related field required.
• Relevant study: Master's, PhD, or postdoctoral study in physics, applied physics, or a related field is encouraged.
• Skills: Complex problem solving, logical analysis, clear explanation, research, creativity, and lateral thinking.
• Equipment: A reliable desktop or laptop and a good internet connection.
• Work arrangement: Individual freelance contractor and part-time assignment.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples, including writing and rating model responses and evaluating their reasoning. Physics experts are needed to create accurate problems and judge solutions that require real subject knowledge.