Software Engineer, AI Research and Evaluation

You will create code examples and solutions used to train and benchmark AI models. You will also review AI-generated code for correctness, efficiency, scalability, reliability, and software engineering standards.

• Build Python agents and automated tools that detect code errors and assess solution quality.
• Design ways to automatically check solutions to software engineering tasks.
• Evaluate AI coding skills across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and maintenance.
• Work with technical teams to improve AI coding results against industry benchmarks.

What it pays and takes

• Location: Open to candidates in the United States.
• Time commitment: 20 or more hours per week.
• Work type: Contract, part-time.
• Required: At least three years of software engineering experience, strong Python skills, and knowledge of production-grade frameworks, tools, and practices.
• Required: Experience building full-stack applications and deploying scalable software, with strong skills in software architecture, design, development, debugging, and code review.
• Required: Strong written and spoken communication skills for writing clear evaluation explanations.
• Helpful: Experience with advanced AI or intelligent systems, a strong computer science foundation, and familiarity with JavaScript, ReactJS, C/C++, Java, Rust, or Go.
• Language: Fluent in English.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses examples and human reviews to help teach and evaluate AI systems. Software engineers contribute the technical judgment needed to create and assess code examples.