Code Reviewer (JavaScript) for Open-Source Repositories

You will evaluate real JavaScript software projects to help measure how well AI systems handle software engineering and bug-fixing tasks. The work includes reviewing codebases, issues, tests, and AI-generated fixes.

• Analyze and triage issues in open-source JavaScript libraries.
• Set up and configure repositories, including Docker-based development environments.
• Review unit-test coverage and assess test quality.
• Modify and run code locally, then evaluate bug-fixing results.
• Assess how well large language models handle software engineering tasks.
• Work with researchers to find repositories and issues that challenge AI systems.

What it pays and takes

This is a remote contractor assignment for a short project lasting approximately two to three weeks.

• $25 per approved task.
• At least 20 hours per week.
• Approximately two to three weeks.
• Four hours of overlap with Pacific Time each week.
• Open to contributors based in Latin America.
• At least two years of software engineering experience.
• Strong JavaScript skills and professional fluency in English.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to navigate complex codebases and run, modify, and test projects locally.
• Experience with open-source projects is helpful but not required.
• Experience with large language model research, evaluation projects, developer tools, or automation agents is helpful.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human judgment to help artificial intelligence learn from examples, code, images, text, audio, and model responses. People with software engineering experience are needed to review technical work carefully and assess whether AI systems produce useful, working code.