AI Agent Evaluation Specialist
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Create data science problems, assess AI-generated answers, and explain what would improve them. This remote, part-time project pays $120 per hour and requires professional or research experience plus a relevant bachelor's degree.
Generative AI & RLHF
$120/hr
Compensation
Contract, part-time
Engagement
Remote
Location
Oct 10, 2026
Posted
Open to applicants in
You will help improve AI systems by creating realistic data science problems and reviewing the answers they produce. Your work will draw on modeling, analysis, experimentation, feature engineering, and practical data science judgment.
You will work independently on project tasks in a remote, asynchronous setting and provide clear written feedback that explains both technical issues and real-world feasibility.
This is an ongoing, project-based opportunity designed to fit alongside a current role. The role is part-time and requires at least 20 hours per week, with no set schedule.
Candidates should be able to explain complex data science ideas clearly, work independently, and pay close attention to detail. Experience with A/B testing, causal inference, model development, statistical analysis, or production-scale feature engineering is especially relevant.
Apply on OpenTrain with your resume, then complete the application on the hiring site.
AI training work is the human side of building artificial intelligence. People create examples, review model responses, and explain what good answers should look like, while experienced specialists are paid for the judgment they bring to complex topics.
Keep exploring
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Use hands-on quantitative experience to create challenging problems, evaluate AI-generated answers, and improve model reasoning. This remote, flexible project pays up to $150 per hour and requires 20+ hours per week.
Posted Oct 10, 2026
Create realistic consulting scenarios and review AI-generated answers for accuracy, feasibility, and professional quality. This flexible US contract role pays $115 per hour and uses your strategy, operations, or M&A expertise.
Posted Oct 10, 2026
Evaluate AI agents on finance and business workflows by writing prompts, reviewing responses, and creating structured feedback. This remote part-time contract pays $30 to $40 per hour and requires professional finance experience plus strong Microsoft 365 skills.
Posted Oct 10, 2026
Evaluate AI-generated rates trading strategies using professional judgment on swaps, swaptions, Treasury futures, SOFR products, and repo. This remote contractor role pays $80 to $100 per hour and suits experienced rates professionals.
Posted Oct 10, 2026
Browse related job pages
Expertise
Locations
Languages