GitHub Workflow Evaluation Specialist

About OpenTrain

OpenTrain AI is hiring a GitHub Workflow Evaluation Specialist for remote contractor work in AI training and data labeling. OpenTrain is the #1 platform for finding and building careers in this field, helping contributors discover projects, build a professional profile, and apply in minutes.

• Remote contractor opportunity
• Part-time schedule of 20+ hours per week
• Advertised pay of $90 to $175 per hour
• English-language work
• Eligibility across a broad list of countries

About AI Training Work

AI training is the human side of building modern artificial intelligence. Contributors complete realistic tasks, document decisions, and evaluate outputs so AI systems can learn from accurate examples and better reflect real-world workflows.

This role focuses on software development and collaboration workflows. Your GitHub expertise will help produce high-quality interaction data and evaluation materials for AI system development.

• Contribute to cutting-edge AI development
• Use professional or open-source workflow knowledge
• Work remotely with flexible contractor responsibilities

The Role

As a GitHub Workflow Evaluation Specialist, you will complete realistic GitHub workflows involving repositories, branches, commits, pull requests, issues, and collaboration features. You will document the technical steps and decisions involved, then turn completed workflows into prompts and detailed evaluation rubrics.

The role requires current access to GitHub, practical Git knowledge, and the ability to explain technical processes clearly while recording your screen.

• Complete assigned GitHub workflows using provided instructions
• Create, edit, review, and manage repositories
• Produce interaction data for AI system development
• Review task outputs for accuracy and project quality alignment

What You'll Do

You will demonstrate common software development and version control activities in realistic environments. Your work will combine hands-on GitHub execution, clear technical documentation, and evaluation of the resulting task outputs.

• Create and work with branches
• Merge changes and create commits
• Create and manage pull requests
• Work with GitHub issues and collaboration features
• Record your screen while demonstrating workflow steps
• Explain the tools and actions used during each workflow
• Create realistic prompts based on completed workflows
• Write detailed rubrics for evaluating task performance
• Check outputs for accuracy and adherence to quality standards

Requirements

Strong hands-on GitHub experience is required. This experience may come from professional work, project-based development, or open-source environments. You should be able to use GitHub independently and apply practical version control workflows without step-by-step supervision.

You must also be comfortable recording and sharing your screen while demonstrating technical work, communicating processes clearly, and working independently as a remote contractor.

• Hands-on experience with GitHub repositories and collaboration workflows
• Practical Git skills, including branching, merging, commits, and pull requests
• Ability to create realistic prompts and detailed evaluation rubrics
• Ability to explain technical workflows clearly while recording your screen
• Strong attention to detail
• Current access to the GitHub platform
• Ability to work independently in a remote contractor setting

Helpful Background

Prior experience with human data or AI evaluation can support success in this role. Familiarity with annotation, labeling, reinforcement learning from human feedback, model evaluation, or related work is helpful alongside your GitHub expertise.

• Human data experience
• Data annotation or labeling
• RLHF or AI response evaluation
• Model evaluation
• Familiarity with repositories, pull requests, issues, and collaboration workflows

Pay, Schedule, and Eligibility

This part-time contractor opportunity is advertised at $90 to $175 per hour and requires a commitment of 20 or more hours per week. The listing supports applicants across the countries specified in the opportunity details. Confirm your location and availability when applying through OpenTrain.

• Payment type: hourly
• Rate: $90 to $175 per hour
• Time requirement: 20+ hours per week
• Employment type: contractor and part-time
• Working language: English

How to Apply Through OpenTrain

Create a free OpenTrain account to apply for this opportunity and build a profile that reflects your AI training and data-labeling experience. Your GitHub workflow background, technical demonstrations, and evaluation skills can help you develop a durable portfolio in a fast-growing area of tech.

• Apply through OpenTrain
• Highlight hands-on GitHub and Git experience
• Showcase relevant human data or AI evaluation work
• Build your long-term AI training portfolio