Senior Backend Engineer (Python/FastAPI) AI Evaluation

You will create and evaluate software engineering data used to train and benchmark large language models. The work combines backend engineering, code correction, structured evaluation, and automated testing.

• Curate Python code examples for backend services, data pipelines, and machine learning infrastructure.
• Build solutions, correct AI-generated code, and improve implementations for quality and reliability.
• Create Python agents and automated verification tools that find error patterns and test solution quality.
• Evaluate model capabilities across prototyping, architecture, API design, production implementation, launches, experiments, monitoring, and operational maintenance.
• Design ways to automatically verify solutions to software engineering tasks.
• Contribute coding solutions measured against industry performance benchmarks.

The role is a flexible contractor engagement for professionals based in the United States. The initial engagement lasts one month, with possible extensions based on performance and fit.

• Time requirement: 20+ hours per week.
• Experience: At least three years of software engineering experience.
• Technical skills: Strong Python expertise, including production frameworks and tooling, plus experience building full-stack applications and deploying scalable software.
• Engineering knowledge: Architecture, design, development, debugging, and code quality assessment.
• Evaluation skills: Ability to write clear, structured explanations for technical evaluations.
• Additional experience with JavaScript, ReactJS, C, C++, Java, Rust, or Go is valuable.
• Language: Professional fluency in English.