Software Engineer, AI Research and Evaluation (US-Based)

You will create and review code examples used to train and benchmark AI models. The work calls for production engineering judgment across full-stack software.

• Curate code examples and develop precise solutions for AI training projects.
• Correct and refine backend and frontend code using Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
• Rate AI-generated code for architecture, efficiency, scalability, reliability, and production readiness.
• Build agents and automated checks that assess code quality and identify error patterns in full-stack applications.
• Evaluate model abilities across prototyping, architecture and API design, implementation, launch, experimentation, monitoring, and operational maintenance.
• Work with cross-functional teams on industry performance benchmarks.

What it pays and takes

• Pay: Not specified.
• Time commitment: 20+ hours per week.
• Location: Open to candidates based in the United States.
• Engagement: Individual contractor role, initially one month, with possible extensions based on performance and fit.
• Required experience: At least three years in software engineering, including strong full-stack development with Python and JavaScript, React, and Node.js.
• You should have experience deploying scalable, production-grade software and deep knowledge of software architecture, design, development, debugging, and code review.
• You should be able to assess code systematically and explain your decisions clearly in writing and conversation. Fluency in English is required.
• Experience building production systems at high-scale engineering organizations is helpful. Computer science or related academic preparation is also helpful; demonstrated engineering skill and experience are the main considerations.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human-reviewed examples to help models learn and improve. Software engineers contribute their expertise by creating, checking, and evaluating code examples.