Senior Software Engineer, LLM Code Evaluation (US-Based)

Create and refine code examples and software solutions for large language model training and benchmarking. Review AI-generated code and judge whether it is correct, efficient, scalable, reliable, and ready for production.

• Build Python agents and automated tools that find error patterns and check software solutions.
• Assess model-generated work across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and ongoing operations.
• Help develop AI coding solutions and evaluate them against industry performance benchmarks.
• Write clear, structured explanations for your evaluations.

Time, location, and requirements

• Location: Open to candidates based in the United States.
• Time: At least 20 hours per week.
• Engagement: Part-time contractor role planned for one month, with possible extensions based on performance and fit.
• Bring strong Python skills, including knowledge of production frameworks, development tools, and best practices.
• Have experience building full-stack applications and deploying scalable software, with knowledge of software architecture, development, debugging, and code review.
• JavaScript and ReactJS, C/C++, Java, Rust, or Go experience is relevant.
• Be fluent in English.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind AI systems: people review examples and model answers so systems can learn from useful, accurate feedback. Software engineers bring the skills to assess generated code and build tools that check whether solutions work reliably.