Senior Backend Engineer (Python/FastAPI) AI Evaluation

You will assess AI-generated code and other software engineering materials using project guidelines. Your reviews will help AI systems learn from code examples and clear, evidence-based feedback.

• Review source materials and model outputs against project guidelines.
• Apply project rubrics and document evidence-based judgments.
• Explain your judgments clearly so the feedback can improve model behavior.
• Maintain consistent, high-quality reviews across repeated tasks.

What it pays and takes

• Pay information is not provided.
• Time commitment: 20 or more hours per week; the schedule is described as flexible.
• Location: Open to candidates in the United States.
• At least 3 years of software engineering experience.
• Strong skills building full-stack applications with Python and JavaScript, including React and Node.js, and working across backend and frontend codebases.
• Experience deploying scalable, production-grade software with modern languages and tools.
• A deep understanding of software architecture, design, development, debugging, and code quality review.
• Clear spoken and written English for explaining evaluation judgments.
• Graduates of Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, or comparable programs are welcome; strong experience and skills take priority over school background.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is human work that helps AI systems learn from examples, including reviewing generated code and explaining judgments. Projects draw on experienced people’s subject knowledge to assess work and provide useful feedback.