Senior Python Code Reviewer

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is hiring and contracting for this role, connecting experienced technical contributors with projects that help shape how modern AI systems learn.

Creating an OpenTrain account is free, and candidates can apply in minutes.

• Contractor and part-time opportunity
• Available to candidates in India, the Philippines, and Vietnam
• Work in English

About AI Training and Code Evaluation

AI training is the human side of building artificial intelligence. People review examples, evaluate model responses, and identify errors so AI systems can become more accurate, useful, and reliable.

In this role, your Python expertise will help assess AI-generated code and the quality of the evaluations used to train AI models.

• Contribute to the development of advanced AI systems
• Use technical judgment to evaluate model-generated programming responses
• Support accurate, reliable training data through structured review

The Role

OpenTrain AI is hiring Senior Python Code Reviewers to audit annotator evaluations of AI-generated code. You will perform proof-of-work checks to determine whether each code snippet follows its prompt, executes correctly, and meets security best practices.

You will catch rating errors, provide concise and constructive feedback, and uphold project guideline standards within a structured quality assurance workflow. Docker proficiency is required for running and validating isolated code environments.

• Experience level: Expert
• Pay: $18 USD per hour
• Time requirement: Less than 20 hours per week
• Work arrangement: Part-time contractor

What You'll Do

You will review Python programming responses and verify both their technical correctness and evaluation quality. Reviews require careful execution checks, security awareness, and clear written documentation.

• Audit annotator evaluations of AI-generated Python code
• Check whether code follows the original prompt
• Run proof-of-work checks to verify that snippets execute correctly
• Validate code in sandboxed or containerized environments
• Assess advanced syntax, debugging, edge-case handling, and test-driven development
• Identify security issues such as injection, unsafe deserialization, race conditions, and permission errors
• Use Docker build, run, exec, volume mounts, and troubleshooting fundamentals
• Apply checklists and rubric scoring in structured QA or annotation workflows
• Provide concise, constructive feedback and documentation
• Protect the accuracy of AI training data by correcting rating errors

Required Qualifications

You must have at least seven years of hands-on Python experience, with mastery of advanced syntax, debugging, edge-case design, and test-driven development. Strong written English is essential for clear feedback and documentation, with a B2 or higher CEFR level expected.

The role also requires reliable remote work habits, stable technical setup, and the ability to meet milestones in a structured review process.

• At least seven years of hands-on Python experience
• Deep Python knowledge through version 3.12
• Experience with Python idioms, standard libraries, virtual environments, and dependency management
• Advanced debugging and testing skills using pytest or unittest
• Knowledge of coverage, profiling, and edge-case design
• Secure-coding mindset and ability to identify common vulnerabilities
• Mandatory Docker proficiency
• Experience validating code through sandbox or container execution
• Clear written English at B2 CEFR or higher
• Reliable remote setup and milestone discipline

Preferred Experience

The following experience is preferred but is not listed as mandatory. It can help you contribute effectively to AI evaluation and quality assurance projects.

• LLM or RLHF evaluation experience
• Familiarity with annotation platforms
• Experience mentoring other reviewers or technical contributors

Why Work in AI Training

AI training and data labeling are among the fastest-growing ways to work in technology. This work is often flexible and can fit around other commitments, while giving specialists a direct role in shaping the behavior of state-of-the-art AI systems.

As a senior Python reviewer, you will apply advanced software skills to a growing field where human judgment remains essential for evaluating generated code.

• Flexible part-time workload of under 20 hours per week
• Remote-focused work for eligible countries
• Apply specialized Python, testing, Docker, and security knowledge
• Help improve the quality of AI-generated programming data

How to Apply

Create a free OpenTrain account and apply through OpenTrain for consideration. Be prepared to demonstrate the Python, Docker, testing, security, code-validation, QA, and written communication skills required for this expert reviewer role.

• Apply through OpenTrain
• Confirm your eligibility in India, the Philippines, or Vietnam
• Highlight relevant Python, Docker, testing, and AI evaluation experience