Software Engineer, AI Code Evaluation

Create and refine programming examples used to train and assess AI models. You will write and correct code, review AI-generated solutions, and build Python tools that check code quality and identify recurring errors.

• Evaluate code across software design, APIs, production implementation, testing, monitoring, and maintenance.
• Assess solutions for efficiency, scalability, reliability, and performance.
• Work mainly with Python, with evaluation tasks also covering JavaScript, Java, C, C++, Rust, and Go.
• Work with other teams to improve AI coding systems.

What it pays and takes

• Pay: $200 per hour.
• Time commitment: 20 or more hours per week.
• Location: Remote; open to candidates in the United States.
• Engagement: Contractor role with an initial one-month project and potential extensions.
• You should have strong production-grade Python skills, experience building full-stack applications and deploying scalable software, and a strong grasp of software design, development, debugging, and code review.
• Working knowledge of JavaScript, Java, C, C++, Rust, or Go is relevant to the evaluation work.
• You need strong written and spoken communication skills to explain your evaluations clearly.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human work behind AI systems: people prepare examples and review model outputs so systems can learn from them. Experienced software engineers are needed to create reliable code examples and judge whether AI-generated solutions work well.