Senior Software Engineer, LLM Evaluation (US-Based)

Evaluate AI-generated code and full-stack examples so AI systems can learn from careful software engineering review. Apply project guidelines and explain your judgments clearly.

• Review source materials and model outputs against project guidelines.
• Assess code quality, architecture, development choices, and debugging.
• Document evidence-based judgments and write clear evaluation rationales.
• Maintain consistent, high-quality reviews across repeated tasks.

Pay, schedule, and requirements

• Pay details are not provided.
• Schedule: Flexible, with a requirement of 20+ hours per week.
• Location: Open to candidates in the United States.
• Skills: Strong full-stack application development with Python and JavaScript, including React and Node.js.
• Skills: Experience deploying scalable, production-grade software and a deep understanding of software architecture, design, development, debugging, and code review.
• Communication: Excellent spoken and written English for clear, structured evaluation rationales.
• A degree from a computer science program is helpful, but exceptional experience and skill are also valued.

How to apply

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human review and feedback that helps AI systems learn from examples, including code and written evaluations. OpenTrain helps people find AI training projects across the industry, build a profile, and apply.