Medicine LLM Evaluation Expert

The title and description of this role name different fields. Check the duties and qualifications below before you apply.

You will help evaluate how well large language models understand and explain medicine. The work combines medical research judgment, prompt writing, and careful review of AI-generated responses.

You will work mainly asynchronously and independently on expert tasks that test scientific and language capabilities in advanced AI systems.

• Create prompts about medicine and specialized medical topics.
• Review AI responses for scientific accuracy, clarity, and meaningful understanding.
• Research specialized medical topics with assistance from AI.
• Identify strengths and limitations in AI-generated medical explanations.
• Compare technical responses with the standards of the medical field and provide evidence-based judgments.

This project is suited to medical experts who can explain important concepts clearly and assess technical content. Experience with emerging research areas, scientific writing, medical education, or technical content evaluation can help you contribute.

• Work arrangement: Remote, asynchronous project work with flexible hours.
• Time requirement: 20+ hours per week.
• Language: Professional fluency in English.
• Education: M.D., D.O., or PhD from a US institution.
• Strong medical expertise, research ability, clear medical communication, and comfort working independently.