Senior PowerShell Code Reviewer

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. Create a free account, build your profile, and apply in minutes.

AI training is the human work behind modern artificial intelligence. Technical experts review and improve model-generated code, helping create reliable examples and evaluations for next-generation AI systems.

The Role

We are seeking a senior PowerShell engineer to audit annotator reviews of AI-generated PowerShell scripts. You will validate each submission in an isolated environment, confirm that it satisfies the prompt and runs correctly, and assess whether it follows secure scripting and automation best practices.

You will correct inaccurate ratings and provide clear, actionable feedback so every review aligns with the quality rubric. Your work will help protect the quality of data used to train next-generation AI models.

• Contractor, part-time position
• Pay: $24 USD per hour
• Time requirement: 20+ hours per week
• Languages: English
• Eligible countries: India, the Philippines, and Vietnam
• Experience level listed for the project: Intermediate

What You'll Do

You will combine hands-on PowerShell development, secure code review, testing, and structured quality assurance. The work requires executing scripts in sandboxed environments and making evidence-based judgments against defined prompts and review criteria.

• Audit annotator reviews of AI-generated PowerShell scripts
• Execute scripts in isolated or sandboxed environments to verify functional compliance
• Confirm that scripts satisfy the prompt and run correctly
• Evaluate idempotence, error handling, and parameter validation
• Identify credential leaks, injection risks, unescaped inputs, and excessive privilege escalation
• Correct mis-ratings and provide clear, constructive, actionable feedback
• Use rubric-based scoring, checklist reviews, and ticketing or annotation tools

Requirements

The ideal candidate has 5 to 7 or more years of professional experience in PowerShell development, automation engineering, or dedicated code-review roles. You should be comfortable assessing both functional behavior and secure implementation quality across PowerShell scripts.

• Expert knowledge of PowerShell 5.x through 7.x Core
• Advanced functions, modules, remoting, and pipeline patterns
• Strong scripting and automation skills, including idempotence and try/catch/finally error handling
• Experience with input validation using Validate attributes
• Ability to detect and mitigate credential leaks, injection risks, unescaped inputs, and excessive privilege escalation
• Experience with Pester unit testing, PSScriptAnalyzer, and debugging tools
• Familiarity with Windows and cross-platform automation
• Familiarity with Azure or AWS modules and CI/CD pipelines
• Excellent written English at B2 CEFR level or higher
• Ability to deliver constructive feedback and mentor others

Preferred Experience

Experience with AI evaluation, reinforcement learning from human feedback pipelines, or previous AI and machine-learning data-labeling projects is welcome. Familiarity with these workflows can help you understand how technical reviews support the development of capable AI systems.

• LLM evaluation experience
• RLHF pipeline experience
• Prior AI or ML data-labeling experience

Why Work in AI Training

AI training and data labeling are fast-growing ways to work in technology. Contributors with programming expertise directly influence how AI systems understand, generate, and evaluate code, while flexible project work can fit around other commitments.

OpenTrain brings together opportunities to start and grow an AI training career. Work is remote across the industry, and many projects are designed for flexible schedules and workloads.

• Apply advanced PowerShell expertise to cutting-edge AI development
• Work on practical code evaluation and quality assurance
• Build experience in AI training and model evaluation
• Choose flexible work that can fit alongside other commitments

How to Apply

Create a free OpenTrain account, complete your profile, and apply through OpenTrain AI. Be prepared to demonstrate senior-level PowerShell development, secure scripting judgment, testing ability, and clear written feedback.

• Confirm that you are based in India, the Philippines, or Vietnam
• Confirm availability for 20+ hours per week
• Highlight relevant PowerShell, automation, code-review, testing, and security experience
• Showcase any LLM evaluation, RLHF, or AI data-labeling background