Senior PowerShell Code Reviewer

About OpenTrain

OpenTrain AI is the #1 platform for people building careers in AI training and data labeling. We connect skilled contributors with projects that teach real-world AI systems how to behave and improve over time.

Work through OpenTrain to access flexible, remote projects that let you shape next-generation AI while choosing hours that suit your life. Creating an OpenTrain account is free.

• OpenTrain hires and contracts directly for this role.
• Work is 100% remote and well suited to part-time schedules.

About AI training and why this work matters

AI training is the human side of building intelligent systems: people prepare, check, and improve the examples models learn from. That includes reviewing code outputs from models, validating correctness and safety, and ensuring high-quality feedback drives model improvements.

As a reviewer you’ll directly influence how automated systems generate scripts and how they handle security, reliability, and maintainability.

• Contributors work on cutting-edge problems that shape model behavior.
• Many projects require domain knowledge rather than prior annotation experience.

The role

You will audit annotator reviews of AI-generated PowerShell scripts to ensure every submission meets the prompt and our quality rubric. Your work combines hands-on script execution in isolated sandboxes with expert judgment about secure, reliable automation.

OpenTrain AI is hiring a Senior PowerShell Reviewer as a part-time contractor for ongoing annotation QA and mentoring of annotators.

• Role type: Contractor, Part-time (20+ hours/week).
• Work location: Remote, worldwide.

What you'll do

Your day-to-day focuses on validating annotator decisions and improving the dataset quality used to train models. Tasks are hands-on and feedback-oriented.

• Execute and validate submitted PowerShell scripts in sandboxed environments to confirm they satisfy the prompt and run correctly.
• Verify secure scripting and automation best practices: idempotence, error handling, and parameter validation.
• Detect credential leaks, injection risks, unescaped inputs, and unnecessary privilege escalation.
• Correct mis-ratings and provide clear, actionable feedback aligned to the quality rubric.
• Use testing and analysis tools (Pester, PSScriptAnalyzer, debuggers) to reproduce and diagnose issues.
• Document findings in ticketing/annotation tools and mentor annotators to raise review quality.

Requirements

Candidates must bring senior-level PowerShell expertise and demonstrated experience reviewing or developing production automation scripts.

• 5–7+ years of professional PowerShell development, automation engineering, or code-review experience.
• Expert knowledge of PowerShell 5.x–7.x (Core), advanced functions, modules, remoting, and pipeline patterns.
• Strong skills in writing idempotent scripts, using try/catch/finally, and input validation ([Validate*] attributes).
• Proven ability to identify and mitigate credential leaks, injection risks, unescaped inputs, and privilege escalation.
• Familiarity with Pester, PSScriptAnalyzer, and script debugging tools.
• Comfortable executing scripts in sandboxed environments to verify behavior and compliance.
• Experience with platform integration (Windows and cross-platform automation) including Azure/AWS modules and CI/CD pipelines.
• Skilled in rubric-based scoring, checklist reviews, and using ticketing tools (Jira, Asana).
• Excellent written English (B2+ CEFR) and ability to deliver concise, constructive feedback.

Who should apply

Apply if you are a senior PowerShell engineer who enjoys hands-on validation, mentoring, and improving annotation quality used to train AI systems. This role suits people who prefer flexible, remote contracting work and who can reliably follow structured QA rubrics.

• Ideal for engineers experienced in secure scripting and automation code review.
• Great for automation engineers or devops professionals who like teaching and quality assurance.
• Nice-to-have: prior experience evaluating LLM outputs, RLHF pipelines, or AI/ML labeling projects.

Pay, schedule, and how to get started

Compensation is $24 USD per hour, paid on a contractor basis. Expected commitment is 20+ hours per week. OpenTrain handles contracting and project assignment through its platform.

To apply, create an OpenTrain account (free), complete your profile, and submit for the Senior PowerShell Code Reviewer role. If selected, you'll be given project access and sandboxed environments for validation tasks.

• Payment: PAY_PER_HOUR at USD 24/hr.
• Employment types: Contractor, Part-time.
• Time requirement: 20+ hours/week, flexible scheduling.
• Worldwide applicants accepted; strong written English required.