Advanced Mathematics LLM Evaluation Expert

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this freelance opportunity. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping contributors discover projects, build a professional profile, and apply in minutes.

• Free account creation
• Remote opportunities across the AI training industry
• A way to build experience teaching and evaluating artificial intelligence

About AI Training Work

AI training is the human side of building modern artificial intelligence. People create examples, evaluate model responses, and provide precise feedback so AI systems can reason more accurately and communicate more effectively.

In this role, your mathematics expertise will help test the limits of large language model reasoning. Your problems, solutions, annotations, and benchmark contributions can support the development of more capable AI systems.

• Work remotely with a computer and internet connection
• Contribute to cutting-edge generative AI evaluation
• Choose a part-time workload of 20 or more hours per week

The Role

OpenTrain AI is recruiting an Advanced Mathematics LLM Evaluation Expert for freelance contract work. You will design, solve, and evaluate complex mathematics problems that challenge large language models in multi-step, abstract, and proof-based settings.

The work combines advanced mathematical reasoning with text generation, response evaluation, Python-based computational tasks, and theorem-prover work in Lean.

• Employment type: Part-time contractor
• Experience level: Entry level
• Work location: Worldwide and fully remote
• Primary language: English
• Data type: Text

What You’ll Do

You will create rigorous evaluation content and assess whether model-generated solutions are mathematically correct, complete, and clearly justified. The role requires independent problem solving as well as careful written feedback and annotation.

• Design original, challenging mathematics problems that test LLM reasoning limits
• Solve complex problems independently with detailed, logically structured solutions
• Review model-generated solutions and identify mathematical errors
• Provide precise feedback and annotations on model outputs
• Develop and validate Python-based solutions for computational tasks using approved scientific libraries
• Translate problems and proofs into formal language for theorem-prover tasks using Lean
• Contribute to new evaluation benchmarks

Requirements

You should have a strong foundation in advanced mathematics and the ability to analyze difficult problems using a structured, logical approach. Clear written communication is essential because you will explain mathematical concepts and provide detailed evaluations in simple, understandable language.

• Graduate-level or PhD-level knowledge of advanced mathematics
• Knowledge of areas such as algebra, calculus, analysis, geometry, or topology
• Experience designing original, multi-step mathematics problems for evaluation
• Ability to review and give detailed feedback on model-generated solutions
• Proficiency in Python for computational tasks
• Familiarity with theorem-proving tools such as Lean
• Self-motivation and ability to work independently in a remote setting
• Desktop or laptop with a reliable internet connection

Helpful Background

A Master's, PhD, or postdoctoral background in Mathematics, Applied Mathematics, Statistics, or a related field may be helpful for this work. Experience with Python, scientific libraries, and formal theorem proving can also support success in the role.

• Advanced graduate-level mathematics experience
• Experience with Python programming and scientific libraries
• Experience using theorem provers such as Lean
• Strong ability to communicate complex mathematical ideas clearly

Apply Through OpenTrain

Create a free OpenTrain account and apply to this remote contractor opportunity. AI training work offers a way to use specialized expertise on real evaluation projects while building experience in a rapidly growing technology field.

• Review the role requirements before applying
• Highlight advanced mathematics, Python, and Lean experience in your profile
• Apply for flexible part-time work of 20 or more hours per week