DevOps / SRE / Cloud Engineer – Coding Agent Evaluation

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the leading platform for finding and building careers in AI training and data labeling, helping contributors discover projects, build a professional profile, and grow in a fast-moving industry.

About AI Code Evaluation

AI training is the human side of building artificial intelligence. Technical experts help improve modern models by writing, reviewing, and evaluating code and model-generated solutions. Your engineering judgment will help assess how well frontier coding systems handle realistic infrastructure challenges.

• Remote work with flexible, project-based opportunities
• Directly contribute to the development of cutting-edge AI coding systems
• Apply professional engineering expertise to model evaluation

The Role

OpenTrain AI is recruiting a DevOps / SRE / Cloud Engineer with coding agent experience to evaluate and improve frontier AI coding models through structured technical assessments. You will use leading AI coding agents to complete realistic infrastructure engineering tasks and assess their generated implementations.

This is a remote, part-time contractor role requiring 20+ hours per week. The listed compensation is $85 USD per hour.

• Role type: Contractor and part time
• Work arrangement: Remote and project based
• Pay: $85 USD per hour
• Languages: English
• Eligible locations: Canada, the United States, Costa Rica, Guatemala, Mexico, Panama, Denmark, Estonia, Finland, Ireland, Latvia, Lithuania, Norway, Sweden, Austria, Belgium, France, Germany, the Netherlands, Switzerland, the United Kingdom, Albania, Bosnia and Herzegovina, Croatia, Greece, Italy, M

What You'll Do

You will work with frontier AI coding agents and evaluate their performance across complex infrastructure engineering scenarios. The work combines hands-on technical execution with careful review of model-generated implementations.

• Complete and evaluate infrastructure engineering tasks involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
• Review model-generated implementations for bugs, edge cases, reliability issues, and failure modes.
• Compare outputs from multiple frontier models and assess their relative strengths and weaknesses.
• Apply professional engineering judgment to realistic infrastructure and reliability engineering scenarios.
• Help ensure that AI coding model evaluations are technically accurate and high quality.

Required Qualifications

This role is listed as entry level in the source information, while the role requirements call for at least two years of professional experience. Applicants should review the technical requirements carefully before applying.

• At least 2 years of professional DevOps, SRE, or Cloud Engineering experience.
• Hands-on experience with one or more of AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
• Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
• Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred Experience

• Experience supporting production-scale systems.

How This Work Fits Your Career

AI training and data-labeling work is expanding beyond basic annotation into specialized technical evaluation. By reviewing AI-generated infrastructure solutions, experienced engineers can help shape how advanced coding models behave in real-world engineering contexts while building experience in a rapidly developing field.

• Use your existing DevOps, SRE, and cloud expertise in AI development.
• Work remotely with a defined weekly time commitment.
• Contribute to the evaluation of state-of-the-art coding agents.