Public Health AI Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for people building careers in AI training and data labeling. We help freelancers find and manage specialized AI training work, build a single verified portfolio, and grow a durable freelance career in the human side of AI.

• OpenTrain AI is the hiring organization for this role.
• You’ll join a community shaping how state-of-the-art AI systems behave while keeping control of your proof-of-work and profile.

About AI training and data-labeling work

AI training (also called data labeling or human feedback work) is the human side of building artificial intelligence: people create, review, and correct examples that teach models to respond reliably. This work is highly flexible, often remote, and a fast-growing way to work in tech.

In this role you’ll do expert evaluation and content creation that directly guides model behavior on public-health topics — an opportunity to influence safety and accuracy in health-related AI outputs.

• Many projects need no prior experience, but specialist roles like this one pay more for domain expertise.
• Typical work includes rating model outputs, fact-checking claims, and authoring gold-standard answers.

The role

As a Public Health AI Evaluation Expert you will review AI-generated public-health and population-health responses, rate them for correctness, clarity, safety, and reasoning quality, and write high-quality expert explanations and model solutions.

Tasks combine evaluation (rating model answers) and text generation (creating gold-standard responses and prompts) focused on epidemiology, surveillance, prevention, policy, and risk communication.

• Work type: remote contractor, part-time.
• Time expectation: 20+ hours/week.
• Labeling tasks: evaluation rating and text generation on public-health content.

What you'll do

This role centers on critical appraisal of model outputs and creation of authoritative guidance so models learn accurate public-health reasoning and safe recommendations.

• Review AI responses on epidemiology, public health practice, prevention, policy, and risk communication.
• Compare multiple model answers and score them for correctness, clarity, and scientific rigor.
• Identify unsafe recommendations, misleading causal claims, and weak evidence interpretation.
• Create gold-standard answers and detailed prompts when expert public-health content is needed.
• Validate that public-health guidance is reliable across different populations and settings.

Requirements

You must meet the educational and experience requirements and demonstrate strong public-health reasoning and clear written English.

• Degree: Bachelor’s or higher in Public Health, Epidemiology, Biostatistics, Health Policy, Global Health, or a related field.
• Experience: 5+ years of professional public-health experience in government, NGOs, academia, healthcare systems, global health, consulting, or similar.
• Skills: strong epidemiologic reasoning, understanding of causality, bias and confounding, screening concepts, vaccination principles, and population-level disease processes.
• Communication: clear written English (minimum C1) for precise feedback and explanations.
• Preferred: experience with AI data training, guideline development, systematic reviews, program evaluation, policy analysis, or editorial QA.

Helpful background

These additional areas will make your evaluations stronger but are not strictly required.

• Health equity and social determinants of health.
• Risk communication for uncertain or evolving evidence.
• Surveillance definitions, rates vs. risks, denominators, and time horizons.
• Comfort fact-checking statistical claims and spotting unsafe or misleading recommendations.

Schedule, pay, and locations

This is remote contractor work with flexible hours; we expect contributors to provide at least 20 hours per week. OpenTrain offers country-specific hiring variants in selected countries and pays hourly with country-based rate adjustments.

• Hourly pay (USD): $45–$70 per hour (hourly rate varies by country; nominal top rate listed $70/hr).
• Languages required: English (en).
• Eligible countries include: BD, BT, BR, KH, DE, IN, ID, MY, NP, PK, SG, LK, TH, PH, US, TL, VN.

How to apply and what happens next

Apply through your OpenTrain profile. Your application should demonstrate relevant public-health experience and include examples of prior evaluation, guideline, review, or policy work if available.

If selected you will complete task-specific training and qualification tests before starting paid work. Training ensures consistency in ratings and the quality of gold-standard content.

• Role type: contractor, part-time. Label types: EVALUATION_RATING and TEXT_GENERATION.
• OpenTrain helps you build a verified portfolio of AI training work you control, making it easier to find future projects.