Clinical Geneticist Healthcare AI Evaluation Consultant

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. OpenTrain helps experts discover cutting-edge projects, build their profiles, and apply in minutes. Creating an OpenTrain account is free.

• Remote contract consulting opportunity
• Applicants must be based in the United States
• Expected commitment is under 20 hours per week
• Expected project duration is 1 to 3 months

About Healthcare AI Evaluation

AI training is the human side of building artificial intelligence. In healthcare, qualified professionals review model responses, identify unsafe or unsupported conclusions, and help improve how AI handles complex clinical information.

Your evaluations will help assess whether healthcare AI can reason clearly about rare disease cases, communicate uncertainty, recognize important findings, and provide clinically useful responses.

• Contribute to the development of safer, more accurate healthcare AI
• Use specialist clinical knowledge in a flexible, remote project
• Help identify model failure patterns and improve evaluation standards

The Clinical Geneticist Consultant Role

OpenTrain is seeking a US-licensed Clinical Geneticist to evaluate the quality, safety, and clinical usefulness of healthcare AI and large language model responses to complex, longitudinal rare disease cases. This consulting assignment does not involve direct patient care and does not create a physician-patient relationship.

You will work with de-identified clinical information covering histories, phenotypes, genetic testing, treatments, and outcomes. Your work will inform structured assessments and a professional healthcare AI evaluation report.

• Expert-level contract role
• Pay range: $50 to $80 per hour
• Part-time schedule of less than 20 hours per week
• US-based applicants only
• Fluent English proficiency required

What You'll Do

You will assess AI-generated responses against the clinical details of longitudinal rare disease cases. Reviews should consider not only whether an answer is factually correct, but also whether its reasoning, uncertainty, safety, and communication are appropriate.

You will also help translate expert judgment into repeatable evaluation criteria and practical recommendations for improving healthcare AI systems.

• Review de-identified cases involving clinical histories, phenotypes, genetic testing, treatments, and outcomes
• Evaluate clinical accuracy, completeness, reasoning, safety, uncertainty, and patient communication
• Assess recognition of key phenotypes, diagnostic clues, genotype-phenotype relationships, differential diagnoses, and appropriate next steps
• Identify hallucinations, missed findings, unsupported claims, and potentially unsafe recommendations
• Develop or refine structured evaluation rubrics and critical-error criteria
• Provide written feedback and corrected responses where appropriate
• Identify and severity-classify key model failures
• Contribute findings and actionable recommendations to a final healthcare AI evaluation report

Required Qualifications

This role requires advanced clinical genetics expertise and prior hands-on experience assessing healthcare AI or LLM systems. You should be comfortable making careful judgments about complex rare disease cases and documenting your reasoning in clear, professional writing.

• MD or DO with an active US medical license
• Clinical experience evaluating or managing patients with genetic rare diseases
• Experience interpreting genetic testing, variants, inheritance patterns, and genotype-phenotype relationships
• Previous hands-on experience evaluating, validating, red-teaming, training, or benchmarking healthcare AI or LLM systems
• Strong clinical judgment and professional writing skills
• Ability to work with sensitive, de-identified clinical information under strict confidentiality requirements

Preferred Qualifications

The following experience can strengthen your application and may be especially relevant to the evaluation framework and deliverables.

• Board certification in Clinical Genetics and Genomics, Medical Genetics, Pediatric Genetics, Genetic Neurology, or a related specialty
• Familiarity with HPO terminology, ACMG variant classification, OMIM, GeneReviews, ClinVar, and Orphanet
• Experience with patient-facing medical AI, clinical decision support, AI safety, RLHF, post-training, or model evaluation frameworks
• Experience developing physician scoring rubrics, failure taxonomies, or clinical validation reports

Project Deliverables and Application Details

The selected consultant will contribute to a defined set of clinical evaluation materials and reviews. To apply through OpenTrain, share your specialty, state license or licenses, board-certification status, relevant rare disease experience, prior healthcare AI or LLM evaluation work, availability, and hourly or project-based rate.

The selected consultant must sign confidentiality, data-use, and work-product agreements before beginning the project.

• Structured clinical evaluation rubric for rare disease AI responses
• Completed reviews of an agreed-upon set of model responses
• Identification and severity classification of key model failures
• Written recommendations addressing clinical accuracy, safety, and patient communication
• Input into a final healthcare AI evaluation report
• Application details: specialty, licenses, certification status, experience, availability, and rate