Medical AI Response Evaluation Expert (Physicians)

You will create challenging medical tasks and evaluate AI-generated responses across real clinical workflows. Your work will help assess whether responses are accurate, safe, and consistent with current medical practice.

You will explain clinical reasoning clearly while protecting patient confidentiality. The work may cover diagnosis, differential reasoning, imaging and test interpretation, treatment planning, and procedural decisions.

• Create expert-level medical tasks based on clinical decisions and workflows.
• Review AI responses for clinical accuracy, patient safety, and alignment with medical guidelines.
• Write clear, structured feedback that helps improve AI model performance.
• Apply physician-level judgment across relevant medical specialties and care settings.

This is ongoing, project-based contract work that can be completed alongside a current role. The work is remote and flexible, with no set schedule or minimum hour requirement stated in the role description.

• Time: 20 or more hours per week.
• Education: Completed MD, DO, or equivalent medical degree.
• Training: Current or completed residency or fellowship, or board certification or eligibility, in a relevant specialty.
• Medical knowledge: Working knowledge of at least one area such as emergency medicine, critical care, neurology, cardiology, oncology, infectious disease, obstetrics and gynecology, ophthalmology, or surgery.
• Skills: Strong written communication, careful attention to detail, and the ability to work independently in a remote, asynchronous setting.
• Privacy: Do not share patient health information or identifiable patient data.