AI Agent Evaluation Specialist
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Browse current remote roles in AI training, model evaluation, RLHF, data annotation, and expert review. Filter by country, language, and specialty, then apply through OpenTrain.
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Use hands-on quantitative experience to create challenging problems, evaluate AI-generated answers, and improve model reasoning. This remote, flexible project pays up to $150 per hour and requires 20+ hours per week.
Posted Oct 10, 2026
Create data science problems, assess AI-generated answers, and explain what would improve them. This remote, part-time project pays $120 per hour and requires professional or research experience plus a relevant bachelor's degree.
Posted Oct 10, 2026
Create realistic consulting scenarios and review AI-generated answers for accuracy, feasibility, and professional quality. This flexible US contract role pays $115 per hour and uses your strategy, operations, or M&A expertise.
Posted Oct 10, 2026
Review AI-generated diagnoses, treatment plans, and medical case summaries for accuracy, safety, and completeness. This remote contractor assignment requires US medical licensure, active practice, and 20 or more hours per week for 12 weeks.
Posted Oct 10, 2026
Review and improve annotated video data for AI training projects. This remote contract role offers flexible work for experienced video annotation professionals available for 20+ hours per week.
Posted Oct 10, 2026
Annotate video footage by creating and reviewing bounding boxes, correcting errors, and following detailed project guidelines. This remote, part-time contract role requires three or more years of annotation experience, English fluency, and 20+ hours per week.
Posted Oct 10, 2026
Review scientific materials, improve AI-generated answers, and explain your judgments in Life Sciences Scientific Reasoning projects. This remote contractor role is open worldwide and requires fluent English plus relevant subject expertise.
Posted Oct 10, 2026
Work 20+ hours a week on analytical language-model training, including research, reasoning, data interpretation, summaries, and detailed feedback on model answers. Open worldwide to candidates with strong English skills.
Posted Oct 10, 2026
Review language-model responses, apply clear evaluation rubrics, and explain your judgments in English. This remote contractor project runs for 2 to 3 weeks with tasks of about 60 minutes each.
Posted Oct 10, 2026
Review inpatient pediatric records, clinical notes, and FHIR data to assess AI-generated medical claims and documentation. Pay is $80 to $125 per hour equivalent, paid per task that meets project specifications.
Posted Oct 10, 2026
Review adult inpatient records, FHIR data, and clinical notes for AI training. The role pays $80 to $125 per hour equivalent, paid per task that meets project specifications, and requires board certification in Internal Medicine.
Posted Oct 10, 2026
Review short video and audio clips, assess AI-generated descriptions, and explain content-quality decisions using clear project guidelines. This remote contract role pays $8 to $10 per hour and requires fluent English.
Posted Oct 10, 2026
Review AI-generated fixed income and rates research, backtests, and systematic trading strategies as a contractor. Earn $80-$150 per hour and apply through OpenTrain before completing the hiring-site application.
Posted Oct 10, 2026
Review finance-focused AI responses, write evaluation rubrics, and give structured feedback using your professional financial judgment. This remote contractor role pays $30 to $40 per hour and involves flexible, asynchronous collaboration.
Posted Oct 10, 2026
Review AI-generated rates trading strategies for realism, market viability, and risk awareness using your professional rates-market experience. This part-time contract pays $80 to $100 per hour, with applications through OpenTrain.
Posted Oct 10, 2026
Review inpatient medical records, clinical notes, and FHIR data to help improve AI systems. Pay is $80 to $125 per hour equivalent, paid per task that meets the project specifications.
Posted Oct 10, 2026
Evaluate two AI agents as they handle everyday tasks such as bookings, shopping, payments, and email. Record each attempt, score the experience, and provide written feedback for $25 to $45 per hour.
Posted Oct 9, 2026
Manage annotation, data collection, analysis, reporting, and quality workflows for AI training projects. This entry-level contract role pays $40 to $60 per hour and requires at least 20 hours weekly.
Posted Oct 9, 2026
Create realistic Earth sciences tasks for AI training and evaluation using scientific code, environmental datasets, simulations, and automated tests. This remote contractor role is open worldwide and requires fluent English and advanced technical experience.
Posted Oct 9, 2026