Senior Python Code Reviewer — Docker Required

About OpenTrain AI

OpenTrain AI is the #1 platform for building careers in AI training and data labeling. We connect people with projects that teach and shape modern AI systems, offering flexible, remote work and a pathway to grow in a fast-moving industry.

Why AI Training Work Matters

Human review and annotation are how modern AI models learn to behave. Contributors check outputs, correct errors, and ensure training signals are accurate — work that directly influences model safety, reliability, and usefulness.

These roles are often remote, flexible, and accessible: many projects require domain knowledge or language fluency rather than formal degrees, and specialist skills command higher pay.

The Role — Senior Python Code Reviewer

As a Senior Python Code Reviewer you will audit annotator evaluations of AI-generated Python code. Your job is to run proof-of-work checks, confirm that snippets implement the prompt, execute correctly in isolated environments, and meet security best practices.

This is a part-time contractor position (less than 20 hours/week), fully remote and open worldwide. Pay is $18 USD per hour.

What You'll Do

• Execute AI-generated Python snippets in Docker sandboxes to verify functionality and reproduce results.
• Evaluate whether code follows the prompt, handles edge cases, and adheres to project rubrics and checklists.
• Identify security issues (injection, unsafe deserialization, permission errors, race conditions) and escalate or annotate according to guidelines.
• Run and author unit tests (pytest/unittest), check coverage indicators, and note missing test cases or flaky behavior.
• Provide concise, actionable written feedback for annotators and QA records in the project workflow.
• Catch rating errors, apply rubric scoring, and maintain accurate annotations for downstream model training.

Minimum Requirements

• 7+ years hands-on Python experience showing mastery of advanced syntax, standard library, and idiomatic patterns.
• Deep familiarity with Python up to and including 3.12 (dependency management, virtual environments).
• Mandatory Docker proficiency: build/run/exec, multi-stage images, volume mounts, and container troubleshooting.
• Strong testing and debugging skills (pytest or unittest, coverage analysis, profiling, edge-case design).
• Secure-coding mindset: able to spot injection, deserialization issues, race conditions, and permission flaws.
• Clear written English for concise technical feedback (CEFR B2 or higher).
• Reliable remote work setup and discipline to meet milestones and QA schedules.

Preferred Qualifications

• Experience evaluating LLM outputs, RLHF workflows, or other generative-AI annotation projects.
• Familiarity with annotation platforms, structured QA workflows, checklists, and ticketing tools.
• Mentoring or leadership experience in code review, QA, or developer education.

Schedule, Pay, and Logistics

This contract role is part-time with under 20 hours per week of expected work. Hourly pay is $18 USD. Work is remote and may be completed from anywhere worldwide.

You will work within structured QA workflows and submit feedback and scores through the project's tooling. Expect to run code inside Docker containers for each review and to document findings clearly and concisely.

How To Apply

Create or sign in to your OpenTrain AI profile, complete your skills and experience details, and apply to this role. Include a brief summary of your Python and Docker experience and any examples of code review, testing, or RLHF evaluation work.

Selected applicants will be asked to complete a skills verification workflow that demonstrates Python debugging, test-writing, secure-coding checks, and Docker-based execution.