Audit and validate annotator evaluations of AI-generated JavaScript/React code by running proof-of-work checks, verifying execution, and enforcing security and guideline standards. Part-time, remote contractor role (20+ hrs/week) paying $24/hr for experienced React reviewers.
Coding & Software
100% Remote Hourly · $24/hr
$24/hr
Compensation
Worldwide
Eligibility
Intermediate
Experience
Jul 8, 2025
Posted
Open worldwide
Interested in this role?
Create a free OpenTrain account and apply in minutes.
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We hire contributors to do the human work that teaches AI systems how to behave—annotating, reviewing, and validating data that powers state-of-the-art models.
About AI training work
AI training (data labeling and human evaluation) is the human side of building modern models. Contributors work remotely, often part-time and flexibly, to annotate, test, and review model outputs across text, code, audio, and visual domains. This role focuses on code evaluation—helping ensure AI-generated code is correct, secure, and follows prompts.
The role
You will audit evaluations produced by data annotators who assess AI-generated JavaScript/React code. Your job is to run proof-of-work checks that verify each snippet follows the prompt, executes correctly in a sandbox, and meets security and quality standards.
Work as a Senior Code Reviewer focused on JavaScript and React.
Validate annotator ratings, catch rating errors, and provide concise corrective feedback.
Uphold project guidelines and rubric-based scoring to protect training data integrity.
What you'll do day-to-day
You will review annotator evaluations rather than writing the original labels. Your checks will combine static review, test execution, and security/performance assessment to confirm correctness and compliance with prompts and project rubrics.
Run proof-of-work checks in sandboxes or containers to reproduce behavior and confirm functional correctness.
Verify prompt compliance, execution results, and edge-case handling.
Evaluate performance and accessibility considerations (bundle size, Web Vitals, WCAG issues).
Provide clear, concise feedback to annotators and document disagreement reasons per rubric.
Requirements
We require substantial hands-on experience with modern JavaScript and React, strong testing and debugging practice, and familiarity with developer toolchains and secure coding.
7+ years professional experience in JavaScript and React development, code review, or QA.
Deep React knowledge: Hooks, Context, Suspense, Concurrent features, SSR/Next.js, and common state-management patterns (Redux, Zustand, Context+Reducer).
Fluent in modern JavaScript (ES2023+) and TypeScript; experience with bundlers (Vite/webpack) and dependency managers (npm, pnpm, Yarn).
Advanced testing/debugging: Jest, React Testing Library, Cypress or Playwright; coverage and profiling experience.
Performance & accessibility experience: optimizing bundle size, rendering, Web Vitals, and WCAG compliance.
Comfortable with Docker (build/run/exec), CI/CD (GitHub Actions, GitLab CI), and code-review platforms (PRs/MRs).
Experienced with rubric-based scoring and ticketing tools (Jira, Asana) in structured QA workflows.
Proof-of-work validation experience: running code in sandboxes/containers to confirm prompt compliance.
Excellent written English (B2+ CEFR) to give concise, constructive feedback and documentation.
Nice-to-have
These are not required but help you ramp faster on AI-centric projects.
Exposure to LLM evaluation, RLHF pipelines, or data-labeling platforms used for model training workflows.
Schedule, pay, and logistics
This is a remote contractor, part-time role with a minimum expected commitment of 20+ hours per week. Open to applicants worldwide. The role pays $24 USD per hour and uses hour-based, contract compensation.
Time requirement: 20+ hours/week.
Employment type: Contractor, Part-time.
Pay: $24 USD per hour.
100% remote and open worldwide.
How to apply and next steps
If you meet the experience requirements and want to help ensure high-quality code evaluation for AI training, apply through OpenTrain. Successful applicants will complete a sample auditing exercise to demonstrate proof-of-work validation, rubric application, and ability to write concise feedback.
Application includes a hands-on audit exercise; results determine qualification for project work.
Join OpenTrain AI to audit AI-generated TypeScript + React code: compile, run in sandboxes, verify prompt compliance, and correct annotator ratings with clear feedback. Remote, contract, 20+ hrs/week at $25/hr—requires 7+ years of professional TypeScript/React experience.
Join OpenTrain AI to audit AI-generated Node.js code by running snippets in sandboxed containers, correcting mis-ratings, and giving concise feedback to meet security, performance, and quality rubrics — $24/hr, 20+ hrs/week, fully remote.