JavaScript Quality Assurance Lead

About OpenTrain

OpenTrain is the #1 platform for people who build careers in AI training and data labeling. We help contributors find and grow work that teaches AI systems — from annotating data to evaluating model outputs — and provide the tools and workflows teams need to scale high-quality human feedback.

This role is hired and managed by OpenTrain. You'll join a distributed community working on the human side of AI development and help set quality standards that shape how models behave.

About AI training work

AI training (data labeling / annotation / human feedback) is how modern models learn: people create, review, and rate examples that teach systems to write code, answer questions, transcribe audio, and more. Work is typically remote and flexible, with many projects open to contributors without prior AI experience and specialist projects paying more for technical expertise.

This position sits at the intersection of software QA and RLHF-style evaluation: you'll assess generated code, rate responses, and help maintain the rubrics and calibration tasks that keep contributor output reliable.

The role

As a JavaScript Quality Assurance Lead you will review AI-generated JavaScript and the work of trainers and QAs for correctness, reasoning quality, runtime behavior, debugging accuracy, readability, maintainability, performance, security awareness, test coverage, formatting, instruction-following, and rubric alignment. You'll lead quality efforts across distributed contributors, update documentation, and support onboarding and activation of contributors.

• Position type: Contractor, part-time (20+ hours/week).
• Location: United States only; English required.
• Pay: $70.00 per hour.
• Work focuses on JavaScript AI training projects and evaluation-rating / RLHF tasks.

What you'll do

Day-to-day work combines hands-on code review with people-facing quality leadership. You'll provide precise written feedback, maintain documentation, and keep contributors calibrated to project rubrics.

• Review AI-generated JavaScript code, debugging responses, implementation explanations, frontend/backend snippets, tests, and step-by-step reasoning.
• Evaluate trainer and QA submissions against project-specific guidelines and rubrics, and record ratings for evaluation workflows.
• Give clear, structured feedback on correctness, async logic, browser vs Node.js differences, security, performance, readability, and test coverage.
• Maintain and update style guides, trackers, FAQs, honeypots, calibration tasks, onboarding materials, and other quality documents.
• Communicate recurring issue patterns and workflow changes to trainers and QAs and support their onboarding and activation.

Requirements

You must have strong JavaScript expertise and experience reviewing code or mentoring technical contributors. Clear written English is essential because feedback and coordination are primarily asynchronous and text-based.

• Strong JavaScript knowledge across closures, scope, hoisting, prototypes, promises, async/await, event loop behavior, modules, DOM manipulation, and error handling.
• Professional experience in JavaScript development, code review, software QA, technical mentoring, or related workflows.
• Ability to spot incorrect logic, non-executable code, missing edge cases, insecure recommendations, and incomplete explanations.
• Comfort using common JS tools/environments such as Node.js, React, Vue, Express, Jest, Mocha, Playwright, ESLint, Prettier, GitHub, and project trackers.
• Strong written English communication for technical feedback and team coordination.

Helpful background

These qualifications are not required but will help you excel and move faster in the role.

• Experience leading or supporting remote teams of trainers, reviewers, engineers, technical writers, or QAs.
• Experience with AI training, data annotation, prompt or response evaluation, code content QA, or rubric-based LLM evaluation (RLHF/evaluation-rating).
• Familiarity maintaining calibration tasks, documentation standards, and workflow quality processes.

Logistics, compensation, and how we work

This is an hourly remote contractor role for contributors located in the United States. Expect at least 20 hours per week; scheduling is flexible but requires consistent availability for coordination with distributed trainers and QAs. Pay is $70 per hour, paid on an hourly contractor basis.

Work products include rubric evaluations, written feedback, updated documentation, calibration tasks, and occasional contributor onboarding support.

Who should apply and next steps

Apply if you are an experienced JavaScript engineer or QA who enjoys teaching, writing clear technical feedback, and improving distributed workflows. This role suits people who want flexible, remote, part-time contractor work that directly shapes how AI systems are trained to reason about code.

If this matches your background and availability, create or sign in to your OpenTrain account and submit your profile and application to join the project team.