Software Engineer, AI Research and Evaluation (US-Based)

You will create and review code examples used to train and benchmark AI models. The work calls for production engineering judgment across full-stack software.

• Curate code examples and develop precise solutions for AI training projects.
• Correct and refine backend and frontend code using Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
• Rate AI-generated code for architecture, efficiency, scalability, reliability, and production readiness.
• Build agents and automated checks that assess code quality and identify error patterns in full-stack applications.
• Evaluate model abilities across prototyping, architecture and API design, implementation, launch, experimentation, monitoring, and operational maintenance.
• Work with cross-functional teams on industry performance benchmarks.

• Time commitment: 20+ hours per week.
• Engagement: Individual contractor role, initially one month, with possible extensions based on performance and fit.
• Required experience: At least three years in software engineering, including strong full-stack development with Python and JavaScript, React, and Node.js.
• You should have experience deploying scalable, production-grade software and deep knowledge of software architecture, design, development, debugging, and code review.
• You should be able to assess code systematically and explain your decisions clearly in writing and conversation. Fluency in English is required.
• Experience building production systems at high-scale engineering organizations is helpful. Computer science or related academic preparation is also helpful; demonstrated engineering skill and experience are the main considerations.