Mathematics LLM Evaluation Expert

As a Mathematics LLM Evaluation Expert, you will help assess how well AI systems solve advanced mathematics problems. You will work with model-generated solutions, computational tasks, and formal proofs.

Your work will cover mathematics from early undergraduate through doctoral level and require clear written reasoning, careful review, and precise feedback.

• Design challenging mathematics problems that test multi-step, abstract, and proof-based reasoning.
• Solve problems independently and write logically structured solutions with clear justifications.
• Review AI-generated solutions, find mathematical errors or missing arguments, and provide corrections and annotations.
• Create and validate Python solutions using approved scientific libraries.
• Translate mathematical problems and proofs into Lean and check that the formal proofs compile correctly.

What it pays and takes

This is a fully remote contractor assignment for candidates worldwide. The work is conducted in English, and the expected commitment is at least 20 hours per week.

Pay details are not provided in the role information. Available commitment options are 20, 30, or 40 hours per week.

• Schedule: At least 20 hours per week, with a minimum of 4 hours per day.
• Time overlap: At least 4 hours of overlap with Pacific Time.
• Background: Academic or professional expertise in mathematics, applied mathematics, statistics, or a related field.
• Knowledge: Strong foundations in areas such as algebra, calculus, analysis, geometry, or topology.
• Communication: Explain complex mathematical ideas clearly with structured language and examples, and give constructive feedback.
• Technical skills: Python and scientific libraries are valuable; familiarity with Lean or formal proof verification is beneficial.
• Work style: Strong written communication, attention to detail, independent work habits, and the ability to follow detailed project guidelines.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind artificial intelligence, including writing problems, checking model answers, and reviewing reasoning. OpenTrain AI is the hiring and contracting organization for this role, helping people build experience through work that teaches AI to produce more accurate and useful results.