Biology LLM Evaluation Specialist

About OpenTrain

OpenTrain is the #1 platform for building careers in AI training and data labeling. We connect skilled contributors with evaluative and annotation work that actually shapes how modern AI systems behave.

OpenTrain AI is the hiring and contracting organization for this role. Creating an OpenTrain account is free and lets you build a unified profile to apply, track projects, and grow your work in this fast-growing industry.

About This Role

You will design rigorous biology problems and produce clear, step-by-step solutions used to evaluate the reasoning and scientific understanding of large language models (LLMs). The scope spans early undergraduate through PhD-level biology topics and targets conceptual abstraction, data interpretation, and multi-step scientific reasoning.

This is a remote, part-time contract role requiring 20+ hours per week. Work is conducted in English and is open worldwide.

What You'll Do

• Design biology problems that probe model limits and expose weaknesses in reasoning and data interpretation.
• Write high-quality, rigorous solutions with clear step-by-step explanations and correct scientific reasoning.
• Align problem types and difficulty with evaluation goals in collaboration with LLM researchers.
• Help shape new benchmark sets across biology curricula from early undergraduate to PhD level.
• Apply structured judgment to assess complex scientific prompts and model responses; provide detailed annotations and feedback.

Who We're Looking For / Requirements

This role requires advanced biology knowledge and strong scientific communication. Applicants should be able to convert complex biological problems into clear evaluation items and produce precise, educational solutions.

• Advanced biology knowledge across undergraduate to PhD-level topics.
• Proven ability to design challenging biology questions for evaluation.
• Skill in writing rigorous, step-by-step scientific solutions that are clear and reproducible.
• Experience giving detailed feedback and annotations on scientific content.
• Strong analytical thinking, structured reasoning, and excellent written English.
• Reliable remote-work setup (desktop or laptop) and stable internet connection.
• Availability for 20+ hours per week; this is a contract, part-time role.

Helpful Background

Preferred candidates often hold an MS, PhD, or postdoctoral experience in Biology, Biotechnology, Biochemistry, or a closely related field. Practical experience with biological problem solving and written scientific communication is valuable.

• Master’s, PhD, or postdoctoral study in a relevant biological field.
• Experience producing graded problem sets, solutions, or instructional explanations is a plus.

How the Work Is Structured

Tasks are text-based (data type: TEXT) and include question-answering creation plus evaluation/rating of responses. Labeling and evaluation work will use question_answering and evaluation_rating workflows.

You will collaborate asynchronously with LLM researchers and the OpenTrain team to refine problem families, grading rubrics, and benchmark composition. OpenTrain AI will contract and pay contributors directly; specific rates or payment schedules are provided during hiring.

• Data type: TEXT. Primary label types: QUESTION_ANSWERING and EVALUATION_RATING.
• Employment: Contractor, part-time. Worldwide applicants accepted (English required).

How to Apply

Create a free OpenTrain account and complete your profile highlighting biology training, degrees, and examples of problem-solving or instructional writing.

When applying, include samples or descriptions of biology problems/solutions you have written and a note about your weekly availability (20+ hrs/week). OpenTrain AI will review submissions and follow up with next steps for contracting and onboarding.