Astronomy Quality Assurance Lead

About OpenTrain

OpenTrain is the centralized platform where people build and grow careers in AI training and data labeling. We help contributors show their experience, discover projects that match their skills, and manage a durable portfolio of AI training work.

As the hiring and contracting organization for this role, OpenTrain connects scientific experts with opportunities to shape how AI systems understand and explain astronomy and astrophysics.

Why AI Training Matters

AI training (also called data labeling or human feedback work) is the human side of building AI: people create, review, and rate examples that teach models how to reason, explain, and produce reliable outputs.

This kind of work is often remote and flexible, letting subject-matter experts directly influence model behavior while working part time or contracting around other commitments.

The Role

You will lead quality assurance for astronomy and astrophysics content produced by trainers and AI systems. Your focus is on scientific correctness, proper use of mathematics and units, clear technical communication, and adherence to project rubrics and style.

This position combines hands-on review with contributor coaching: providing written feedback, maintaining examples and calibration tasks, escalating systemic issues, and improving review processes across remote teams.

What You'll Do

• Review explanations, calculations, diagrams, observational interpretations, and step-by-step reasoning for scientific and mathematical accuracy.
• Check trainer and QA submissions against project guidelines, detailed review rubrics, and style expectations.
• Identify recurring quality issues, propose corrections, and communicate updates to align contributors with expectations.
• Maintain and update style guides, FAQs, trackers, honeypots, calibration tasks, onboarding materials, and example libraries.
• Provide clear written feedback to trainers and QAs and support activation follow-up for remote expert contributors.
• Escalate complex or ambiguous scientific issues and recommend process improvements to preserve quality and consistency.

Requirements

You must satisfy the core scientific and communication requirements listed below. These are essential to judge academic-level content and provide precise feedback.

• Degree in Astronomy, Astrophysics, Physics, Space Science, Planetary Science, Cosmology, or a closely related field.
• Strong written English for clear, precise feedback and team coordination.
• Deep subject knowledge in celestial mechanics, stellar evolution, galaxies, cosmology, electromagnetic radiation, observational methods, spectroscopy, planetary systems, black holes, and scientific uncertainty.
• Ability to spot incorrect physical assumptions, wrong units, flawed calculations, hallucinated facts, misleading explanations, and oversimplified conclusions.
• Experience in astronomy/astrophysics research, teaching, science communication, academic review, data analysis, observatory work, or related scientific workflows.
• Experience with AI training, data annotation, LLM evaluation, scientific QA, academic review, or rubric-based review is a strong plus.

Schedule, Pay, and Location

This is a remote contractor role limited to applicants located in the United States. The position is part time and expects 20+ hours per week.

Compensation is hourly at up to $110/hour (USD). OpenTrain hires contractors directly for this role.

Who Should Apply and Next Steps

Apply if you have an astronomy-related degree, track record of evaluating scientific content, and enjoy giving clear written feedback to help others improve. Early-career candidates with relevant research, teaching, or observatory experience and strong rubric-based review skills are encouraged to apply.

To be considered, be prepared to demonstrate your domain expertise and examples of prior review, teaching, or research work when requested by OpenTrain during onboarding.