Developer and Infrastructure AI Workflow Evaluator

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is recruiting contractors for specialized projects where experienced professionals help evaluate and improve the systems shaping modern artificial intelligence.

• Build a credible AI training and evaluation portfolio
• Discover work aligned with your professional expertise
• Apply through a free OpenTrain account

About AI Training and Workflow Evaluation

AI training is the human side of building artificial intelligence. Professionals review examples, test model behavior, and provide informed feedback so AI systems become more accurate, useful, and reliable. In this role, your engineering judgment will help assess whether AI-assisted workflows reflect practical software and infrastructure standards.

• Contribute to cutting-edge AI development
• Apply real-world technical knowledge to model evaluation
• Work remotely with flexible, part-time scheduling

The Role

OpenTrain is seeking a Developer and Infrastructure AI Workflow Evaluator to assess AI-assisted workflows used in software engineering, DevOps, cloud, platform engineering, site reliability engineering, and infrastructure contexts. You will evaluate commands, configurations, technical outputs, and interactions between AI agents and workplace tools.

This contractor opportunity is listed at an entry level and is designed for professionals who can contribute practical domain expertise to hands-on AI training and evaluation work. The role is worldwide, requires English, and involves 20+ hours per week. Compensation is $30 to $80 per hour.

• Employment type: Part-time contractor
• Schedule: 20+ hours per week
• Location: Worldwide and remote
• Language: English
• Pay: $30 to $80 per hour

What You'll Do

You will test and validate AI-assisted workflows for developer and infrastructure tasks. Your evaluations should be detailed, practical, and grounded in how engineering teams actually use their tools and systems.

• Assess AI-generated commands, configurations, and technical outputs
• Evaluate workflows involving GitHub, GitLab, JIRA, AWS, Azure, GCP, Kubernetes, Docker, and Terraform
• Review how AI agents interact with Slack, Google Drive, and Microsoft 365
• Judge accuracy, relevance, usability, and alignment with real-world industry standards
• Document observations and identify technical discrepancies
• Provide detailed written evaluations and recommend improvements
• Flag issues affecting reliability, applicability, or engineering quality
• Participate in asynchronous written collaboration and virtual discussions about workflow requirements

Requirements and Helpful Experience

You should bring professional experience in software engineering, DevOps, site reliability engineering, cloud, platform engineering, or infrastructure. Strong communication is important because the work depends on explaining technical findings clearly and recommending actionable improvements.

Prior AI experience is not required when you have strong professional domain expertise. Experience with AI assistants, connected workplace applications, or multi-application automation workflows can help you contribute effectively.

• Professional experience in software engineering, DevOps, SRE, cloud, platform engineering, or infrastructure
• Hands-on judgment with AWS, Azure, GCP, Kubernetes, Docker, Terraform, CI/CD, or observability workflows
• Ability to assess the accuracy and practical relevance of AI-generated commands and configurations
• Familiarity with GitHub, GitLab, JIRA, or comparable developer and workflow-management platforms
• Experience using AI assistants such as ChatGPT, Claude Code, Claude Cowork, or Codex with development and infrastructure tools
• Experience with workplace connectors, automation tools, or workflows spanning connected applications
• Clear, detailed written and verbal communication

Why Work With OpenTrain

AI training and data-labeling work offers a flexible way to participate in the fast-growing AI industry. Many projects are remote and can fit around other professional, academic, or personal commitments, while specialist expertise can open the door to higher-value evaluation work.

OpenTrain helps you manage AI training opportunities in one place, showcase relevant experience, discover projects that match your skills, and build a durable portfolio in this emerging field.

• Work remotely from anywhere in the world
• Choose flexible work around a 20+ hour weekly commitment
• Use your existing engineering and infrastructure expertise
• Build experience directly related to how advanced AI systems are evaluated

How to Apply

Create a free OpenTrain account, build your professional profile, and apply in minutes. Highlight your software engineering, DevOps, cloud, platform engineering, infrastructure, and technical evaluation experience so your background is easy to assess.

• Create or update your OpenTrain profile
• Showcase relevant tools, platforms, and professional experience
• Apply for the Developer and Infrastructure AI Workflow Evaluator role