Design realistic, difficult benchmark tasks that test AI systems on business operations work. This remote contractor role pays $45 to $90 per hour and typically needs 10 to 15 or more hours per week.
Turning Real Operations Work Into a Defined TaskObjective Grading CriteriaBusiness OperationsProcess Design and OwnershipOperational Reporting and Data Discrepancies
Design realistic legal and compliance tasks that test AI systems across contracts, due diligence, regulation, and risk analysis. Earn $45 to $90 per hour equivalent, paid per task that meets the project specifications.
Turning Real Legal Work Into a Defined TaskContract and Document ReviewComplianceLegalJudgment Under Conflicting Requirements
Design finance and accounting benchmark tasks using spreadsheets, financial statements, audit materials, and other documents. Earn $40 to $90 per hour equivalent, paid per task that meets project specifications, for less than 20 hours per week.
Turning Real Finance Work Into a Defined TaskObjective Grading CriteriaReconciliation and Error DiagnosisJudgment in Reporting and AnalysisWorking Across DocumentsAI training
Work as a Multimodality Quality Analyst reviewing text and large language model outputs, researching claims, and explaining decisions. This worldwide, part-time contractor role requires 20+ hours per week and strong English skills.
Review AI-generated military and defense scenarios for accuracy, realistic assumptions, civilian protection, and sound reasoning. The role pays $80 to $170 per hour and requires professional defense, military operations, conflict analysis, or security research experience.
military operations analysisdefense researchconflict analysisoperational planninginternational humanitarian law (ihl)rules of engagement (roe)
Review AI-generated Army combat scenarios for tactical realism, weapons employment, targeting, and decision quality. This part-time contractor role pays $90 to $170 per hour and requires professional Army experience.
army tacticstactical operationsmission planningweapons employmentoperational decision-makingrules of engagement (roe)
Review AI-generated military operations scenarios, planning, targeting, and weapons employment, then write evidence-based feedback. This remote contractor role pays $90 to $170 per hour and is open to candidates in listed countries.
military operations expertisetactical decision-makingoperational planningrules of engagement (roe)law of armed conflict (loac)scenario evaluation
Evaluate AI-generated military scenarios for operational realism, weapons employment, and tactical decision-making. This remote contract role pays $80 to $170 per hour and requires hands-on weapons systems experience.
weapons systems operationair defense systemsmissile systemsnaval combat systemstactical aviationscenario evaluation
Use fighter aviation experience to evaluate AI-generated military scenarios, tactical decisions, mission planning, and weapons employment. This remote contractor role pays $80 to $170 per hour.
military aviation tacticsmission planningweapons systems expertisecombat operations assessmenttactical decision-makingrules of engagement knowledge
Evaluate AI-generated special operations scenarios using your experience with tactical planning, mission execution, and military decision-making. This remote contractor role pays $80 to $170 per hour and is open in supported locations worldwide.
tactical operations expertisemission planningmilitary tactics and proceduresoperational realism assessmentwritten communicationrules of engagement (roe) knowledge
Review transportation, warehousing, and supply chain materials to help improve AI systems. This remote contract role pays USD $30 to $70 per hour and is open to fluent English speakers in listed countries.
Work remotely for about 15 flexible hours a week evaluating production Rust, backend architecture, APIs, concurrency, performance, and reliability across supported locations.
Evaluate CRM, workflow, integration, policy, and data-quality scenarios for AI training. This remote contractor role pays $40 to $85 per hour and is open to experienced SaaS operations professionals in the United States and Canada.
OperationsCRM OwnershipRevenue Tools Beyond the CRMOperational Judgment and Policy ConflictsData Accuracy and Reporting
Evaluate SaaS revenue operations scenarios, CRM workflows, policy conflicts, and data-quality problems as a remote contractor. Pay is $50 to $100 per hour, with applications started through OpenTrain.
OperationsConflicting Policy ArbitrationCRM Ownership and Data ModelCompliance-Constrained Operations DesignRevenue Data Integrity and Reporting
Evaluate two AI agents on realistic errands such as bookings, shopping, returns, and forms. This remote U.S. contractor role pays $25 to $45 per hour and includes screen recording, scoring, and written feedback.
ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Work as a Machine Learning Researcher creating, solving, reviewing, and validating coding-intensive machine learning tasks. This remote contractor role offers $60 to $120 per hour equivalent, paid per task that meets project specifications, for about 15 flexible hours weekly.
Build and review machine-learning models, training pipelines, inference systems, and Python workflows remotely for about 15 hours per week. Pay is $60 to $120 per hour equivalent, paid per task that meets project specifications.
Review and grade AI-generated military and government reports using intelligence tradecraft, source evaluation, and clear judgment. This remote contractor role pays $80 to $170 per hour.
Evaluate AI-generated military and government content using expertise in military law, international humanitarian law, and lawful operational boundaries. This remote contractor role pays $80 to $170 per hour for work in English.
Evaluate AI responses on civilian protection, proportionality, and humanitarian law. This remote, part-time contractor role pays $80 to $150 per hour and welcomes experienced humanitarian professionals.
Use HUMINT and investigative interviewing skills to evaluate AI training interactions, assess reliability, and explain your reasoning. This remote contractor role pays $80 to $170 per hour for a part-time schedule.
Elicitation strategyReal-time cue readingReliability assessmentInterrogation/investigative questioningAttention to detailHUMINT
Lead a pod of technical trainers creating and reviewing terminal-based materials science tasks for AI training. This four-week contractor assignment requires advanced scientific expertise, programming skills, and at least 40 hours per week.
Lead a pod of 5 to 10 technical trainers creating and reviewing terminal-based computational materials science tasks for AI evaluation. This remote contractor assignment lasts four weeks and requires advanced materials expertise, programming, and Linux skills.
Lead AI training reviews for computational materials science, evaluating simulations, scientific code, and model outputs. The role requires advanced materials expertise, programming skills, and at least 40 hours per week with PST overlap.
Evaluate large language model responses by writing challenging prompts, spotting reasoning and factual errors, and giving evidence-based feedback. This worldwide, part-time contract role requires 20+ hours each week, fluent written English, a relevant master's degree, and three years of experience.
Lead a pod evaluating mathematical terminal tasks for correctness, reproducibility, grading quality, and scientific rigor. This remote, four-week contractor role requires 20+ hours weekly and advanced mathematics experience.
Review AI-generated conversations for safety, accuracy, and policy compliance, then rate responses and explain your decisions. This remote, part-time contract role requires professional English and 20 or more hours each week.
Work on Image Annotation QA by reviewing language model answers, checking facts, and writing detailed feedback. This worldwide, part-time contract role requires strong English and 20+ hours per week.
Classify short AI-generated audio clips by instrument family and specific instrument. This remote, part-time contract role is open worldwide and suits music professionals with a trained ear.
Evaluate AI tools as they complete real digital workflows, document what happens, and provide structured feedback. This remote, part-time contractor role pays $30 to $49 per hour in the United States.
GeneralistChatGPT ProficiencyProblem SolvingAttention to DetailCommunicationTask Execution
