Review large language model code patches for open source repositories, explain your decisions, and assess peer work. This flexible remote contractor role requires demonstrable open source maintenance experience.
The Work
You will evaluate code patches generated by large language models for open source repositories. Your reviews will help improve AI systems by showing whether proposed changes are correct, useful, and suitable for the repository.
You will also review submissions from other subject-matter experts and provide clear written reasoning for each assessment.
- Review AI-generated code patches for repositories you maintain.
- Judge whether proposed changes are correct, useful, and appropriate for the project.
- Write detailed feedback that clearly explains your technical decisions.
- Review work submitted by other subject-matter experts.
- Contribute consistent, high-quality evaluations for AI training.
What It Pays And Takes
This is a remote, part-time contractor role with flexible scheduling. The role description states an expected availability of 15 hours per week, while the structured listing specifies 20+ hours per week; confirm the current expectation during application.
Compensation is listed at $150 to $300 per hour, with payment described as output-based for tasks that meet project specifications.
- Pay: $150 to $300 USD per hour as listed; payment is output-based.
- Work arrangement: Remote contractor role with flexible scheduling.
- Language: English.
- Availability: The source lists both 15 hours per week and 20+ hours per week.
- Experience: Active or demonstrable experience maintaining an open source repository.
- Proof of experience: A clear GitHub or GitLab profile with open source contributions.
- Skills: Code review experience, strong technical writing, and senior-level software engineering expertise.
- Helpful background: Maintaining active contributor communities, reviewing pull requests, and assessing changes in Python, C, C++, Java, TypeScript, Rust, or Go.
- Location: Eligibility is limited to the countries listed for this role.
How It Works
Apply on OpenTrain with your resume and then complete the application on the hiring site.
About AI Training Work
AI training is the human work behind systems that generate and understand code, text, images, and other content. People review examples and model outputs so these systems can become more accurate and useful, and experienced specialists are paid for applying sound judgment to difficult evaluations.