Design realistic HR benchmark tasks for AI systems using payroll, workforce planning, policy, and employee lifecycle expertise. This remote contractor role pays $45 to $90 per hour and takes less than 20 hours per week.
Payroll and Lifecycle OperationsObjective Grading CriteriaTurning Real HR Work Into a Defined TaskPolicy Application in Edge CasesWorking Across Documents
Design realistic, difficult benchmark tasks that test AI systems on business operations work. This remote contractor role pays $45 to $90 per hour and typically needs 10 to 15 or more hours per week.
Turning Real Operations Work Into a Defined TaskObjective Grading CriteriaBusiness OperationsProcess Design and OwnershipOperational Reporting and Data Discrepancies
Work as a Multimodality Quality Analyst reviewing text and large language model outputs, researching claims, and explaining decisions. This worldwide, part-time contractor role requires 20+ hours per week and strong English skills.
Review AI-generated military and defense scenarios for accuracy, realistic assumptions, civilian protection, and sound reasoning. The role pays $80 to $170 per hour and requires professional defense, military operations, conflict analysis, or security research experience.
military operations analysisdefense researchconflict analysisoperational planninginternational humanitarian law (ihl)rules of engagement (roe)
Review AI-generated Army combat scenarios for tactical realism, weapons employment, targeting, and decision quality. This part-time contractor role pays $90 to $170 per hour and requires professional Army experience.
army tacticstactical operationsmission planningweapons employmentoperational decision-makingrules of engagement (roe)
Review AI-generated military operations scenarios, planning, targeting, and weapons employment, then write evidence-based feedback. This remote contractor role pays $90 to $170 per hour and is open to candidates in listed countries.
military operations expertisetactical decision-makingoperational planningrules of engagement (roe)law of armed conflict (loac)scenario evaluation
Evaluate AI-generated military scenarios for operational realism, weapons employment, and tactical decision-making. This remote contract role pays $80 to $170 per hour and requires hands-on weapons systems experience.
weapons systems operationair defense systemsmissile systemsnaval combat systemstactical aviationscenario evaluation
Use fighter aviation experience to evaluate AI-generated military scenarios, tactical decisions, mission planning, and weapons employment. This remote contractor role pays $80 to $170 per hour.
military aviation tacticsmission planningweapons systems expertisecombat operations assessmenttactical decision-makingrules of engagement knowledge
Evaluate AI-generated special operations scenarios using your experience with tactical planning, mission execution, and military decision-making. This remote contractor role pays $80 to $170 per hour and is open in supported locations worldwide.
tactical operations expertisemission planningmilitary tactics and proceduresoperational realism assessmentwritten communicationrules of engagement (roe) knowledge
Review transportation, warehousing, and supply chain materials to help improve AI systems. This remote contract role pays USD $30 to $70 per hour and is open to fluent English speakers in listed countries.
Evaluate CRM, workflow, integration, policy, and data-quality scenarios for AI training. This remote contractor role pays $40 to $85 per hour and is open to experienced SaaS operations professionals in the United States and Canada.
OperationsCRM OwnershipRevenue Tools Beyond the CRMOperational Judgment and Policy ConflictsData Accuracy and Reporting
Evaluate SaaS revenue operations scenarios, CRM workflows, policy conflicts, and data-quality problems as a remote contractor. Pay is $50 to $100 per hour, with applications started through OpenTrain.
OperationsConflicting Policy ArbitrationCRM Ownership and Data ModelCompliance-Constrained Operations DesignRevenue Data Integrity and Reporting
Evaluate two AI agents on realistic errands such as bookings, shopping, returns, and forms. This remote U.S. contractor role pays $25 to $45 per hour and includes screen recording, scoring, and written feedback.
ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Review and grade AI-generated military and government reports using intelligence tradecraft, source evaluation, and clear judgment. This remote contractor role pays $80 to $170 per hour.
Evaluate AI responses on civilian protection, proportionality, and humanitarian law. This remote, part-time contractor role pays $80 to $150 per hour and welcomes experienced humanitarian professionals.
Use HUMINT and investigative interviewing skills to evaluate AI training interactions, assess reliability, and explain your reasoning. This remote contractor role pays $80 to $170 per hour for a part-time schedule.
Elicitation strategyReal-time cue readingReliability assessmentInterrogation/investigative questioningAttention to detailHUMINT
Evaluate large language model responses by writing challenging prompts, spotting reasoning and factual errors, and giving evidence-based feedback. This worldwide, part-time contract role requires 20+ hours each week, fluent written English, a relevant master's degree, and three years of experience.
Review AI-generated conversations for safety, accuracy, and policy compliance, then rate responses and explain your decisions. This remote, part-time contract role requires professional English and 20 or more hours each week.
Work on Image Annotation QA by reviewing language model answers, checking facts, and writing detailed feedback. This worldwide, part-time contract role requires strong English and 20+ hours per week.
Evaluate AI tools as they complete real digital workflows, document what happens, and provide structured feedback. This remote, part-time contractor role pays $30 to $49 per hour in the United States.
GeneralistChatGPT ProficiencyProblem SolvingAttention to DetailCommunicationTask Execution
Evaluate AI model responses, analytic cases, and failure modes in complex data pipelines. This remote contractor role offers flexible scheduling and $60 to $100 per hour.
Review AI-generated military and government content for sound reasoning, targeting and fires utility, policy boundaries, and operational limits. This part-time contractor role pays $70 to $130 per hour and requires strong combat arms or targeting experience.
Use cyber threat intelligence expertise to evaluate AI-generated threat assessments, write boundary cases, and improve defensive analysis. This remote contractor role pays $70 to $110 per hour and is open in listed countries.
Review AI-generated responses for relevance, accuracy, helpfulness, and personalization. This remote 16-week project pays $25 per hour for 20 hours weekly, with eligibility for up to 40 hours.
Assess difficult AI-generated answers, create domain-specific evaluation tasks, and explain factual or reasoning errors. This part-time contract role pays $30 to $60 per hour equivalent, paid per task that meets project specifications.
Review AI conversations, identify missing context, and suggest follow-up questions that improve recommendations. This part-time contractor role requires 20 or more hours per week, English fluency, and relevant professional experience.
Create challenging, research-backed question-and-answer content, test AI responses, and document sources and reasoning. This remote, part-time contractor role pays $20 to $60 per hour equivalent, paid per task.
Research & source triangulationAttention to detailWritten precisionSelf-direction & reliabilityAnalytical thinking
Review AI outputs, write challenging research questions, and explain expert judgments in a flexible research evaluation role. Pay is $30 to $60 per hour equivalent, paid per task that meets the project specifications.
Research & source triangulationAttention to detailWritten precisionSelf-direction & reliabilityAnalytical thinkingResearch mastery
Evaluate large language model responses using business-analysis expertise, create challenging prompts, and write detailed feedback. This remote contract role expects 20+ hours weekly, excellent English, a relevant master’s degree, and three years of experience.
Review and compare chatbot responses for accuracy, relevance, clarity, and completeness in a remote, 16-week project. The role requires at least 20 hours per week across five working days, including weekends as needed.
