Evaluate AI-generated Bash and PowerShell scripts: find bugs, security risks, and portability issues; rate responses and author model solutions. Mid‑senior US‑based contractors with 2–3+ years of scripting experience, Bachelor's required — part‑time up to 20 hrs/week at $40/hr.
Coding & Software
100% Remote Hourly · $40/hr
$40/hr
Compensation
Worldwide
Eligibility
Intermediate
Experience
Dec 19, 2025
Posted
Open worldwide
Interested in this role?
Create a free OpenTrain account and apply in minutes.
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We hire and contract specialists who teach AI systems by reviewing examples, correcting outputs, and authoring high‑quality model responses.
Working with OpenTrain means joining a fast‑growing field where your technical craftsmanship directly improves real AI systems while you keep flexible, remote hours.
About AI training work in automation
AI training (data labeling / RLHF / evaluation) is the human side of building intelligent systems. For automation and infrastructure, that means reviewing scripts, judging suggested fixes, and producing clear, secure, production‑ready answers that models can learn from.
This work is remote and often part‑time — it fits around full‑time jobs, studies, or family life.
Your reviews shape how models recommend and explain infrastructure changes, making them safer and more reliable.
The role
You will evaluate AI‑generated Bash and PowerShell scripting answers and troubleshooting workflows, identify correctness, safety, portability, and performance issues, and write model solutions and explanations that demonstrate best practices.
This is a part‑time contract role (less than 20 hours/week) paid at $40 USD per hour. Open to US‑based applicants only.
Employment type: Contractor, Part‑time
Time requirement: Less than 20 hours/week
Pay: $40/hour (USD)
What you’ll do
Day‑to‑day tasks focus on technical evaluation, comparison, and authoring. Clear written reasoning is essential: you’ll explain problems and fixes step‑by‑step for both models and reviewers.
Review AI‑generated Bash and PowerShell scripts for correctness, readability, safety, performance, and cross‑environment portability.
Fact‑check technical claims and tooling usage, and rate or compare multiple AI responses.
Author high‑quality model answers and explanations that demonstrate best practices for automation scripting.
Use LLMs during your workflow to prompt, validate, and refine code and explanations.
Requirements
Candidates must meet all listed requirements. We will rely on your hands‑on scripting experience and ability to communicate technical reasoning clearly in written English.
Currently located in the United States (required).
2–3+ years professional, hands‑on experience with Bash and/or PowerShell scripting in DevOps/IT automation/infrastructure roles.
Demonstrated experience debugging and maintaining automation scripts in production.
Ability to assess scripts for security/safety, portability, and edge cases.
Familiar with Unix tooling (awk, sed, grep) and shell best practices and/or PowerShell ecosystem tooling (PowerShell Core, DSC, Azure PowerShell modules).
Familiarity with CI/CD pipelines and automation workflows (e.g., Git‑based PR review, pipeline scripting).
Regular use of LLMs for coding, troubleshooting, and review (prompting, validating outputs, correcting issues).
Bachelor’s degree in Computer Science or a closely related technical field (required).
Strong written English (C1+): able to produce step‑by‑step explanations and clear technical documentation.
Who should apply
This role is a great fit for mid‑to‑senior DevOps engineers, SREs, automation engineers, or experienced sysadmins who write and maintain shell or PowerShell automation and enjoy explaining technical decisions in writing.
You enjoy code review and explaining tradeoffs clearly.
You use LLMs as part of your daily workflow and can judge their outputs critically.
You prefer flexible, remote, part‑time contract work and can operate independently.
How it works
OpenTrain manages hiring, contracting, tasks, and payments for this role. After you apply and are accepted, you’ll receive assignments through OpenTrain’s platform with instructions, examples, and evaluation rubrics.
Tasks typically involve short review records, ratings, and writing model solutions; you’ll submit written explanations and scored evaluations through the platform. Feedback cycles help you refine contributions and increase work availability.
Apply with your OpenTrain profile and examples of scripts or reviews if available.
Work remotely on contract, submit evaluations and authored solutions via OpenTrain, and get paid per hour through the platform.
Join OpenTrain AI to audit AI-generated Bash scripts: validate code in isolated environments, enforce security and reliability best practices, and coach annotators. Remote contractor role, 20+ hrs/week at $21/hr.
OpenTrain AI is hiring a Senior PowerShell Code Reviewer to validate annotator reviews of AI-generated PowerShell scripts, running checks in sandboxed environments and giving rubric-based corrections and feedback. Part-time contractor role, 20+ hours/week, $24/hr, remote worldwide.
Lead QA for Bash shell-scripting reviews on OpenTrain's AI training projects — a US-remote contractor role paying up to $65/hr for ~20 hours/week reviewing scripts, mentoring contributors, and maintaining QA materials.