AI Agent Evaluation Specialist
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Use hands-on quantitative experience to create challenging problems, evaluate AI-generated answers, and improve model reasoning. This remote, flexible project pays up to $150 per hour and requires 20+ hours per week.
Generative AI & RLHF
$150/hr
Compensation
Contract, part-time
Engagement
Remote
Location
Oct 10, 2026
Posted
Open to applicants in
You will help improve AI systems by creating difficult quantitative problems and reviewing the answers they produce. Your feedback should show whether an answer is accurate, practical, and consistent with how working quants approach research, trading, risk, and portfolio decisions.
The work is remote and asynchronous. You will complete project tasks independently and use your judgment across quantitative research, alpha or signal generation, trading strategy design and execution, risk modeling, and portfolio construction.
This is a flexible, project-based contractor role for candidates in the United States. The role is listed as entry level, while the work requires hands-on quantitative experience and a relevant degree.
Apply on OpenTrain with your resume, then complete the application on the hiring site.
AI training is the human work behind better artificial intelligence, including writing examples, rating model responses, and explaining what makes an answer accurate or useful. People with specialist knowledge are paid to apply their professional judgment so models can handle realistic technical problems.
Keep exploring
Test two AI agents side by side on real-life errands from a smartphone, record each attempt, and score the experience. This flexible US-based contractor role pays $25 to $45 per hour.
Posted Oct 11, 2026
Create data science problems, assess AI-generated answers, and explain what would improve them. This remote, part-time project pays $120 per hour and requires professional or research experience plus a relevant bachelor's degree.
Posted Oct 10, 2026
Create realistic consulting scenarios and review AI-generated answers for accuracy, feasibility, and professional quality. This flexible US contract role pays $115 per hour and uses your strategy, operations, or M&A expertise.
Posted Oct 10, 2026
Evaluate AI agents on finance and business workflows by writing prompts, reviewing responses, and creating structured feedback. This remote part-time contract pays $30 to $40 per hour and requires professional finance experience plus strong Microsoft 365 skills.
Posted Oct 10, 2026
Evaluate AI-generated rates trading strategies using professional judgment on swaps, swaptions, Treasury futures, SOFR products, and repo. This remote contractor role pays $80 to $100 per hour and suits experienced rates professionals.
Posted Oct 10, 2026
Browse related job pages
Expertise
Locations
Languages