Software Engineer, AI Research and Evaluation (US-Based)

Create and assess coding datasets used to train and evaluate large language models. You will use Python most often, with work also spanning JavaScript, ReactJS, C/C++, Java, Rust, and Go.

• Curate code examples, write solutions, and correct code for training datasets.
• Review AI-generated code for efficiency, scalability, reliability, and quality.
• Build Python agents and automated checks to find error patterns and validate solutions.
• Evaluate AI capabilities across prototyping, architecture and API design, production implementation, launches, experiments, monitoring, and operational maintenance.
• Design ways to verify software engineering tasks and write clear reasons for your evaluations.

What it pays and takes

• Pay: Not provided.
• Hours: 20+ hours per week.
• Location: Open to candidates based in the United States.
• Engagement: Individual contractor role, initially one month, with possible extensions based on performance and fit.
• At least three years of software engineering experience and deep Python expertise, including production frameworks and tools.
• Experience building full-stack applications and deploying scalable software.
• Strong knowledge of software architecture, design, development, debugging, and code review.
• Working ability in JavaScript, ReactJS, C/C++, Java, Rust, or Go.
• Strong written and spoken communication skills for explaining technical judgments.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training uses examples prepared and reviewed by people to help AI systems learn. Experienced software engineers are needed to create coding examples and judge whether generated code is reliable and well designed.