Senior Python Engineer, LLM Code Evaluation

You will help prepare code examples and evaluate AI-generated software for correctness, speed, scalability, reliability, and code quality. The work focuses on backend, infrastructure, and performance-critical software.

• Build or correct code and solutions in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS.
• Create verification agents that find error patterns and assess systems and infrastructure code.
• Evaluate AI capabilities across prototyping, architecture and API design, production implementation, launch, experimentation, monitoring, and ongoing operations.
• Design ways to automatically verify software engineering solutions and work with technical teams to improve coding systems against performance benchmarks.

Commitment and requirements

• Location: Open to candidates in the United States.
• Commitment: 20 or more hours per week.
• Engagement: Contractor, part-time; initial duration of one month, with possible extensions based on performance and fit.
• At least three years of software engineering experience.
• Strong systems programming, infrastructure, or backend development skills, especially in Python, C/C++, Rust, or Go.
• Experience building and deploying scalable, production-grade software, with deep knowledge of architecture, design, development, debugging, and code review.
• Strong written and spoken communication skills for clear, structured evaluation explanations.
• Experience with advanced intelligent systems or AI-related software is helpful.

How to apply

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses examples prepared and reviewed by people to help AI systems learn; code evaluation is one part of that work. Experienced engineers are needed to judge whether generated code is correct, efficient, and reliable.

OpenTrain helps people discover AI training and data-labeling roles, build a profile, and apply. Creating an account is free.