Math Reasoning Evaluator

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. OpenTrain helps people discover meaningful AI work, build their experience, and apply in minutes. Creating an OpenTrain account is free.

About AI Training Work

AI models learn from examples prepared and reviewed by people. In this role, your mathematical judgment helps evaluate how accurately AI systems reason, communicate solutions, and handle advanced quantitative problems.

• Remote work supporting the development of cutting-edge AI systems
• Flexible part-time contract work for contributors with specialized expertise
• A direct opportunity to apply mathematical reasoning, writing, and evaluation skills

The Role

OpenTrain is seeking a Math Reasoning Evaluator with a strong academic background in mathematics or a closely related mathematical field. You will assess AI-generated math responses for correctness, reasoning depth, clarity, and methodological quality.

This role is designed for mathematically specialized candidates rather than generalists. Compensation is $80 per hour, and the work is part-time contract work with a stated time requirement of less than 20 hours per week.

• Compensation: $80 per hour
• Work arrangement: Part-time contractor
• Availability: Minimum 17 to 20 hours per week during active work periods
• Preferred cadence: Approximately 8 hours per day during active sprints
• Language: English
• Eligible countries: Australia, Canada, Denmark, Finland, France, Germany, Japan, the Netherlands, Singapore, South Korea, Sweden, Switzerland, the United Kingdom, and the United States

What You'll Do

You will apply advanced mathematical knowledge and consistent evaluation standards to review model outputs. Your work will combine detailed error analysis, quantitative fact-checking, and clear mathematical writing.

• Review AI-generated mathematics responses
• Judge correctness, reasoning depth, and clarity
• Identify conceptual, methodological, and computational errors
• Check proofs, derivations, calculations, and quantitative claims
• Fact-check quantitative statements using reputable public sources
• Provide precise citations when references are needed
• Write exemplar solutions that demonstrate correct methods
• Rate and compare multiple responses using detailed rubrics
• Apply grading standards consistently and maintain internal consistency

Required Qualifications

You must hold or be pursuing a BS, MS, or PhD in Mathematics, Mathematical Statistics, Applied Mathematics, or a closely related mathematical field from a top-100 university. A general STEM degree does not meet the stated requirement.

You should be comfortable working across core mathematical areas and communicating formal reasoning in clear, rigorous English. Strong written explanations and careful error analysis are central to the role.

• BS, MS, or PhD in Mathematics or a closely related mathematical field, completed or in progress
• Degree from a top-100 university
• Mastery across core areas such as algebra, calculus, probability, and statistics
• Comfort with proofs and formal notation
• C1-level or higher English writing ability
• Ability to produce lucid, rigorous, step-by-step explanations
• Ability to identify subtle conceptual, methodological, and computational errors
• Strong quantitative fact-checking skills
• High attention to detail and consistent rubric application
• Availability for at least 17 to 20 hours per week

Preferred Experience

The role is open to entry-level candidates who meet the specialized academic requirements. Additional experience can strengthen your application, particularly where it demonstrates analytical communication, technical fluency, or familiarity with evaluating complex work.

• Research experience
• Analytical writing or debate experience
• Programming literacy, such as Python or LaTeX
• Previous data-labeling, RLHF, or AI model-evaluation experience

Selection and Onboarding

Onboarding includes two paid assessments designed to evaluate your fit for the work and your ability to apply the project standards. You will complete a paid 1 to 2 hour qualification exam and a paid 1 to 2 hour project exam.

• Paid qualification exam: 1 to 2 hours
• Paid project exam: 1 to 2 hours
• Apply through OpenTrain and present your mathematics background and relevant experience