Medicine LLM Evaluation Expert

The partner title and supplied description name different subjects. Review the duties and qualifications before applying.

You will help evaluate how well large language models understand and explain medicine. The work combines medical research judgment, prompt writing, and careful review of AI-generated responses.

You will work mainly asynchronously and independently on expert tasks that test scientific and language capabilities in advanced AI systems.

• Create prompts about medicine and specialized medical topics.
• Review AI responses for scientific accuracy, clarity, and meaningful understanding.
• Research specialized medical topics with assistance from AI.
• Identify strengths and limitations in AI-generated medical explanations.
• Compare technical responses with the standards of the medical field and provide evidence-based judgments.

What it pays and takes

This project is suited to medical experts who can explain important concepts clearly and assess technical content. Experience with emerging research areas, scientific writing, medical education, or technical content evaluation can help you contribute.

• Pay: Up to $125 per hour.
• Work arrangement: Remote, asynchronous project work with flexible hours.
• Time requirement: 20+ hours per week.
• Location: Open to candidates in the United States.
• Language: Professional fluency in English.
• Education: M.D., D.O., or PhD from a US institution.
• Requirements: Strong medical expertise, research ability, clear medical communication, and comfort working independently.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples, including writing prompts and reviewing model responses. People with specialist knowledge, such as medicine, help assess whether AI explanations are accurate, clear, and useful.