Software Engineer, AI Research and Code Evaluation

Help create datasets used to train and benchmark large language models by curating code examples, writing solutions, correcting implementations, and assessing AI-generated software.

• Work with code in Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
• Evaluate backend, frontend, API, and machine learning code for quality and performance.
• Build agents to find error patterns and check software solutions.
• Assess AI capabilities in software architecture, API design, production implementation, monitoring, and maintenance.
• Design automated checks that test solutions to software engineering tasks.

What it takes

• Bring strong full-stack development experience with Python and JavaScript, including React and Node.js.
• Have experience deploying scalable, production-grade software with modern languages and tools.
• Understand software architecture, design, development, debugging, and code review.
• Communicate clear, structured reasons for technical evaluations.
• Be fluent in English.
• Be based in the United States.
• Be available for 20 or more hours per week.
• This is a contractor engagement with an initial one-month term and possible extensions based on performance and fit.
• Experience with advanced AI systems, large language model training, software benchmarking, automated verification, or agent development is helpful.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work involves people preparing and reviewing examples that help AI systems learn, including code and model responses. Software engineering experience is valuable for judging whether generated code is correct, reliable, and efficient.