Pulmonologist/Intensivist AI Evaluation Expert

Create advanced cases to test how AI systems handle pulmonary and critical care questions. Review their answers and explain clinical errors or limitations clearly.

• Write and solve scenarios on ventilator management, ARDS, COPD exacerbations, and sepsis-related respiratory failure.
• Assess responses for diagnostic accuracy, clinical judgment, evidence-based reasoning, empathy, and safety.
• Evaluate model understanding of interstitial lung disease, pulmonary hypertension, and intensive care protocols.
• Give structured expert feedback to help improve AI systems used in medical reasoning, clinical care, and education.

Qualifications and work arrangement

• Required: an MD or equivalent medical qualification, active clinical practice within the last three or more years, and board certification or an equivalent qualification in Pulmonary Medicine and/or Critical Care Medicine.
• Required: strong expertise in respiratory failure, mechanical ventilation, lung diseases, and ICU management.
• Required: ability to explain complex medical reasoning in clear, patient-friendly language and excellent written and spoken English.
• Helpful: familiarity with digital medical tools and experience communicating clinical decisions in medical or educational settings. Education from a highly regarded institution is valued.
• Remote freelance work, open worldwide, requiring 20-40 hours per week, at least four hours per day, and some overlap with Pacific Time.
• The initial engagement is one month, with the possibility of extension.

How to apply

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human examples and feedback to help AI systems give better answers. Medical experts are needed to judge whether responses are accurate, safe, and based on sound clinical reasoning.