Radiology AI Evaluation Expert

About OpenTrain

OpenTrain AI is recruiting a Radiology AI Evaluation Expert for specialized work at the intersection of clinical practice and artificial intelligence. OpenTrain is the leading platform for finding and building careers in AI training and data labeling, helping contributors discover projects, build a professional profile, and grow their experience in this fast-moving field.

This is remote contractor work for eligible professionals in the United States. You will contribute directly to the quality and safety of AI systems that interpret medical imaging.

• Contractor and part-time opportunity
• Remote work for eligible professionals in the USA
• Pay of $300 to $400 per hour
• English-language work

About AI Training in Radiology

AI training is the human side of building modern artificial intelligence. In medical imaging, expert reviewers help establish reliable reference examples and assess whether model-generated interpretations are accurate, supported by the study, and safe.

This work is more specialized than conventional image labeling. Your clinical expertise will help identify important model errors across diagnostic specialties and shape how advanced AI systems interpret radiology studies.

• Help create reference standards for AI evaluation
• Review model outputs against real diagnostic imaging studies
• Contribute difficult cases that expose meaningful AI errors
• Support safer and more accurate medical AI

The Role

OpenTrain AI is seeking a radiology professional to create rigorous reference standards and evaluate how accurately AI systems interpret de-identified diagnostic studies. You will use clinical judgment to assess measurements, interval changes, structured categories, findings, and conclusions.

The work focuses on expert review and reference creation rather than conventional image labeling. Cases may span multiple diagnostic specialties and imaging modalities.

• Read de-identified CT, MR, radiography, ultrasound, PET/CT, mammography, and other radiology studies
• Write reference reports or document specific findings that define a correct interpretation
• Review AI-drafted radiology reads for inaccurate, unsupported, or unsafe content
• Determine whether measurements, findings, categories, and conclusions are correct and supported

What You’ll Do

You will apply established radiology reporting systems and measurement conventions while reviewing both source studies and AI-generated interpretations. The role requires careful documentation and sound judgment, particularly when model outputs appear plausible but are clinically unsupported or unsafe.

• Apply RECIST, Lung-RADS, BI-RADS, CAD-RADS, ASPECTS, or comparable systems
• Assess clinically appropriate measurements and interval changes
• Evaluate structured categories and reporting conventions
• Identify inaccurate, unsupported, and unsafe AI-generated interpretations
• Contribute challenging cases for testing and improving model performance

Required Qualifications

Board certification or board eligibility in radiology is required. Candidates should currently be reading diagnostic studies or have recently been in active practice.

The role is suitable for professionals who can apply clinically appropriate measurements, structured categories, and reporting conventions while distinguishing accurate interpretations from content that is unsupported or unsafe. ABR, FRCR, EDiR, or an international equivalent is appropriate.

• Board certification or board eligibility in radiology
• Current or recent experience reading diagnostic imaging studies
• Ability to apply RECIST, Lung-RADS, BI-RADS, CAD-RADS, ASPECTS, or comparable systems
• Strong judgment when evaluating AI-generated radiology interpretations
• Familiarity with at least one diagnostic radiology subspecialty

Relevant Subspecialty Experience

Experience in a diagnostic radiology subspecialty is relevant to this work. Residents and fellows in later training may also be considered, provided they meet the role’s clinical requirements.

• Neuroradiology
• Chest radiology
• Abdominal radiology
• Musculoskeletal radiology
• Breast imaging
• Cardiac imaging
• Nuclear medicine
• Pediatric radiology

Schedule, Location, and Pay

This is remote contractor work for eligible professionals in the USA. The structured opportunity supports 20 or more hours per week, with a default commitment of 40 hours per week.

• Location: United States
• Work arrangement: Remote contractor
• Time requirement: 20+ hours per week
• Default commitment: 40 hours per week
• Pay: $300 to $400 per hour

Build Your AI Training Career

OpenTrain gives contributors one place to manage AI training opportunities, present credible experience, and build a lasting professional portfolio. Create a free OpenTrain account to apply and continue developing a career in specialized AI evaluation.

• Create and strengthen your OpenTrain profile
• Showcase specialized AI training experience
• Discover projects aligned with your clinical expertise
• Apply to opportunities through OpenTrain