Software Engineer, AI Research and Evaluation

Create and assess coding examples used to train and benchmark large language models. You will use software engineering judgment to review code and evaluate model capabilities.

• Curate code examples and develop solutions in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS.
• Correct and refine AI-generated code, then assess solutions for architecture, API design, production use, monitoring, and maintenance.
• Evaluate performance against technical benchmarks and build agents that find patterns in errors.
• Design ways to verify software engineering solutions and work with technical teams to improve AI coding systems.

Requirements and schedule

• Strong skills in systems programming, infrastructure, or backend development, especially with Python, C/C++, Rust, or Go.
• Experience building and deploying scalable, production-grade software.
• Knowledge of software architecture, design, development, debugging, and code review.
• Clear written and spoken communication, with the ability to explain technical evaluations in a structured way.
• The role is open to candidates in the United States and requires at least 20 hours per week.
• This is a part-time contractor role. Experience building production systems at a high-scale engineering organization and a strong computer science foundation are helpful.

How to apply

Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is a platform where people can find AI training projects, build a profile, and apply; creating an account is free.

About AI training work

AI training is the human work behind AI systems: people prepare examples and assess model outputs so systems can learn and be tested. Software engineering experience is useful for creating reliable code examples and giving careful technical evaluations.