QA Engineer, AI Code Evaluation

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping people discover projects, build a profile, and apply in minutes. Creating an OpenTrain account is free.

• Expert contractor opportunity in AI training and engineering evaluation
• Applicants must be based in Canada or the United States
• Expected commitment is under 20 hours per week

About AI Training Work

AI training is the human side of building artificial intelligence. Contributors prepare and review examples, evaluate model outputs, and provide structured feedback that helps AI systems become more accurate and useful.

This role focuses on software quality assurance and engineering evaluation. Your testing judgment will help assess technical outputs against defined criteria, making it a strong opportunity to contribute to cutting-edge AI development through flexible, part-time work.

• Review and rate technical outputs using quality criteria and rubrics
• Provide annotations and feedback that improve AI-generated work
• Support the development of better engineering evaluation standards

The Role

OpenTrain AI is expanding its expert network and seeking QA-specialized engineers for high-volume engineering evaluation work. You will apply professional testing experience, QA fundamentals, and familiarity with human data workflows to review, evaluate, and improve the quality of technical outputs.

The expected project duration is 1 to 3 months. This is a part-time contractor role with an hourly pay range of $60 to $112 USD and a listed hourly rate of $100 USD.

• Role: QA Engineer
• Experience level: Expert
• Employment type: Contractor and part-time
• Project duration: Expected to run for 1 to 3 months
• Pay: $60-$112 USD per hour, with a listed rate of $100 per hour
• Weekly commitment: Less than 20 hours

What You'll Do

You will combine hands-on testing expertise with structured evaluation and written feedback. The work includes assessing technical outputs, documenting issues clearly, and helping project teams refine the standards used to evaluate engineering quality.

• Design and execute test cases for functional, regression, and edge-case scenarios
• Perform manual and automated testing
• Document test results with clear, reproducible steps
• Identify, log, and track bugs through structured reporting
• Evaluate and rate technical outputs against defined quality criteria and rubrics
• Provide detailed written feedback and annotations to improve output quality
• Collaborate with project teams to refine evaluation guidelines and testing standards

Requirements and Expertise

This opportunity is intended for experienced QA professionals with a strong understanding of software testing and engineering evaluation. Candidates should be comfortable communicating complex findings clearly in written reports and verbal discussions.

• Professional experience as a QA Engineer, SDET, Test Engineer, or in a similar role
• Strong understanding of test case design, bug tracking, regression testing, and manual and automated testing
• Expertise with bug tracking systems and test management tools
• Experience with computer code programming labeling workflows
• Software quality assurance and engineering evaluation subject-matter expertise
• Strong analytical and problem-solving skills
• Keen attention to detail
• Fluent English proficiency
• Proactive, self-motivated approach with a commitment to quality, collaboration, and continuous learning
• Based in Canada or the United States

Who Should Apply

Apply if you are an experienced QA engineer or testing specialist who wants to use your technical judgment beyond conventional software delivery. This project is suited to contributors who can assess code-related outputs consistently, explain defects and quality concerns precisely, and work independently within defined evaluation standards.

• QA Engineers, SDETs, Test Engineers, and similar professionals
• Testing specialists experienced in both manual and automated methods
• Experts comfortable evaluating technical outputs against rubrics
• Contributors able to commit fewer than 20 hours per week

How to Get Started

Create a free OpenTrain account to build your profile and apply in minutes. OpenTrain brings together opportunities in AI training and data labeling, where skilled contributors help shape how modern AI systems learn, respond, and perform.

• Create your free OpenTrain account
• Highlight your QA, testing, and engineering evaluation experience
• Apply for this expert contractor project
• Complete any project-specific evaluation or onboarding steps