Design original research-grade evaluation tasks based on your computational work. Each task should let AI models be evaluated on expert-level mathematics.
- Set the metrics for judging solutions without revealing the exact passing thresholds.
- Provide a reference solution and tests for each task.
- Revise tasks using structured review feedback until they are approved.
- Optionally review and calibrate tasks from other experts in your field.
What it pays and takes
- Pay: $100 per hour.
- Time: 20+ hours per week, with a flexible task-based schedule and no fixed weekly schedule.
- Location: Open to candidates in the listed countries; this role is not worldwide.
- Language: Fluent English.
- Education: Research-track bachelor's, master's, or PhD student, postdoc, or candidate in mathematics, applied mathematics, statistics, or a closely related field.
- Experience: Hands-on experience writing code, preferably in Python, to implement or validate mathematical methods; ability to turn computational research into a clear task with a reference solution and tests.
- Work independently and manage your own time.
- You must be able to work as an independent contractor without visa sponsorship. F-1 visa holders, including those on OPT or CPT, are not eligible.
- Preferred: Research in numerical methods, optimization, stochastic processes, computational topology, or number theory; public code, a thesis, or papers showing your computational work; or experience in data annotation, data labeling, or AI/ML evaluation.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work uses examples prepared and reviewed by people to help AI models learn and improve. OpenTrain is a platform for finding AI training projects, building a profile, and applying; creating an account is free.