AI Agent Evaluation Specialist
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Create realistic consulting scenarios and review AI-generated answers for accuracy, feasibility, and professional quality. This flexible US contract role pays $115 per hour and uses your strategy, operations, or M&A expertise.
Generative AI & RLHF
$115/hr
Compensation
Contract, part-time
Engagement
Remote
Location
Oct 10, 2026
Posted
Open to applicants in
You will help improve AI systems by creating realistic management consulting problems and scenarios, then reviewing the answers they produce. Your feedback will focus on whether each response is accurate, practical, and consistent with professional consulting work.
Tasks are project-based and completed independently in a remote, asynchronous setting. You may work across strategy, operations, implementation, transaction advisory, and M&A use cases.
This is an ongoing, part-time contract opportunity that can fit alongside another role. The work is remote and asynchronous, with a flexible schedule.
Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is a free platform where people find AI training and data-labeling projects, build a profile, and start applications.
AI training is the human work behind artificial intelligence. People create examples, review model responses, and provide feedback so AI systems can produce more useful results. Specialists are valuable because their professional knowledge helps models handle complex real-world tasks.
Keep exploring
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Use hands-on quantitative experience to create challenging problems, evaluate AI-generated answers, and improve model reasoning. This remote, flexible project pays up to $150 per hour and requires 20+ hours per week.
Posted Oct 10, 2026
Create data science problems, assess AI-generated answers, and explain what would improve them. This remote, part-time project pays $120 per hour and requires professional or research experience plus a relevant bachelor's degree.
Posted Oct 10, 2026
Evaluate AI agents on finance and business workflows by writing prompts, reviewing responses, and creating structured feedback. This remote part-time contract pays $30 to $40 per hour and requires professional finance experience plus strong Microsoft 365 skills.
Posted Oct 10, 2026
Evaluate AI-generated rates trading strategies using professional judgment on swaps, swaptions, Treasury futures, SOFR products, and repo. This remote contractor role pays $80 to $100 per hour and suits experienced rates professionals.
Posted Oct 10, 2026
Browse related job pages
Expertise
Locations
Languages