Chemistry Reasoning Evaluator (BS/MS/PhD)

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We connect people who want flexible, remote work with meaningful projects that teach and correct AI systems — from annotating text to evaluating model reasoning.

About AI Training Work

AI training is the human side of building intelligent systems: people prepare, review, and critique examples so models learn to reason, calculate, and communicate safely. This work is 100% remote, often part-time and flexible, and lets contributors shape how state-of-the-art AI systems behave.

The Role

You will evaluate AI-generated chemistry responses for correctness, depth of reasoning, clarity, and safety. This is a contract, part-time role with competitive hourly pay and an expectation of steady weekly availability during active projects.

• Position type: Contractor, part-time, remote (OpenTrain AI is the hiring organization).
• Pay: $80.00 USD per hour (PAY_PER_HOUR).
• Time: Minimum 17–20 hrs/week; typical time requirement listed as less than 20 hrs/week.
• Onboarding includes paid qualification and project exams (each 1–2 hours).

What You'll Do

Your core task is to read AI-generated chemistry answers and score them using detailed rubrics, while producing exemplar solutions and corrections where needed. Expect to apply domain knowledge and quantitative reasoning to a variety of chemistry topics.

• Assess correctness, reasoning depth, clarity, and educational value of model responses.
• Identify and explain errors in calculations, units, dimensional analysis, and approximations.
• Spot conceptual or methodological mistakes in reaction mechanisms, stoichiometry, thermodynamics, kinetics, and spectroscopy/analytical methods.
• Evaluate safety assumptions and flag hazardous or misleading chemical guidance.
• Fact-check chemical claims using reputable public sources and produce precise, reproducible references when required.
• Draft step-by-step exemplar explanations and model solutions that demonstrate correct reasoning.
• Rate and compare multiple model responses using consistent evaluation rubrics.

Must-Have Requirements

We require solid formal chemistry training, strong scientific writing, and the ability to apply quantitative rigor and reproducible evaluation practices. Candidates must be able to produce clear, stepwise solutions in advanced English and consistently apply rubrics.

• Education: BS, MS, or PhD in Chemistry or a closely related chemical science (Top‑100 university preferred).
• Language: C1+ English for rigorous, step-by-step explanations and clear scientific writing.
• Domain knowledge: Strong foundation across general, organic, inorganic, physical, and analytical chemistry, plus lab/safety literacy.
• Quantitative skills: Dimensional analysis, unit consistency, error/uncertainty awareness, and numerical rigor.
• Attention to detail: Meticulous application of evaluation rubrics and reproducible reasoning.
• Availability: Minimum 17–20 hours per week; preferred cadence ~8 hrs/day during active sprints.
• Onboarding: Paid 1–2 hour qualification exam and a paid 1–2 hour project exam.

Preferred Experience

These qualifications are not required but will strengthen your application and may increase the scope of projects you receive.

• Research experience, technical or analytical writing, or competitive debate experience.
• Programming literacy (e.g., Python, Matlab) and familiarity with LaTeX for clear technical notation.
• Prior data labeling, RLHF, or model-evaluation experience (bonus).