Senior Software Engineer, LLM Evaluation (US-Based)

You will help improve AI coding systems by creating, correcting, checking, and evaluating code. The work spans software development from design and prototyping through production use and ongoing maintenance.

• Create accurate code examples and solutions for backend, frontend, API, and machine learning tasks.
• Review AI-generated code for correctness, maintainability, scalability, and reliability.
• Assess software architecture, API design, production implementation, experimentation, monitoring, and maintenance.
• Build agents that check code quality and find recurring errors in full-stack applications.
• Design automated checks for software engineering tasks and contribute to performance benchmarks.
• Work with cross-functional teams on AI coding systems and evaluation.

Schedule and requirements

• Location: Open to candidates in the United States.
• Schedule: At least 20 hours per week; part-time contractor role.
• Strong full-stack skills in Python and JavaScript, including React and Node.js.
• Experience deploying scalable, production-grade software using modern languages and tools.
• Knowledge of software architecture, design, development, debugging, and code-quality assessment.
• Clear spoken and written communication for explaining evaluation decisions.
• The work may also involve C/C++, Java, Rust, and Go.

How to apply

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training uses examples prepared and reviewed by people to help improve AI systems. Software engineers bring the judgment needed to assess code, and specialist projects may pay more for that expertise.