Senior Backend Engineer (Python/FastAPI) AI Evaluation

You will help create and improve datasets used to train and test large language models. The work applies production software engineering judgment to code examples, AI-generated solutions, and automated checks.

You will work across backend services, data pipelines, machine learning infrastructure, and full-stack applications. Your evaluations will cover code quality, architecture, debugging, scalability, reliability, and practical use in real engineering settings.

• Curate Python code examples for backend services, data pipelines, and machine learning infrastructure.
• Write and correct solutions in Python, JavaScript, ReactJS, C or C++, Java, Rust, and Go.
• Review AI-generated code for architecture, implementation quality, debugging, scalability, and reliability.
• Create Python agents and automated verification tools that test software engineering solutions and find recurring error patterns.
• Assess AI capabilities across prototyping, architecture design, API design, production implementation, launch, experimentation, monitoring, and operational maintenance.
• Work with cross-functional teams to improve AI coding solutions against industry performance benchmarks.

This is an individual contractor engagement with a flexible part-time commitment and an initial duration of one month, with possible extensions based on performance and fit.

• Time: 20 or more hours per week.
• Engagement: Individual contractor and part-time.
• Experience: At least three years of software engineering experience.
• Technical skills: Strong Python expertise, including production frameworks and tooling, plus experience building full-stack applications and deploying scalable software.
• Engineering judgment: Understanding of software architecture, design, development, debugging, and code review.
• Communication: Ability to give clear, structured written and spoken reasons for technical evaluations.