Python Quality Assurance Lead

About OpenTrain

OpenTrain is the #1 platform for building careers in AI training and data labeling. We help freelancers find and grow work that trains AI — consolidate proof-of-work, build a unified portfolio, and advance your career in a fast-growing industry.

As the hiring organization for this role, OpenTrain connects you with Python training projects and provides the tools, documentation, and collaboration spaces you need to review, mentor, and improve contributor output.

About AI training and why it matters

AI training (data labeling / annotation / human feedback) is the human side of building modern AI. Contributors annotate, review, and rate model outputs so models learn to behave reliably.

This role places you at the intersection of software engineering and model evaluation: your judgments and feedback directly influence how Python-focused AI tasks are taught and measured.

The role

OpenTrain is recruiting a Python Quality Assurance Lead to review AI-generated Python code and trainer QA work across Python training projects. You will evaluate correctness, runtime behavior, readability, maintainability, performance, security awareness, formatting, and test coverage, and you will enforce project rubrics.

You will also write clear feedback, maintain Python documentation and style guides, support onboarding, and help improve QA workflows for contributors working on Python tasks.

What you'll do day-to-day

• Review Python code, automation scripts, backend snippets, tests, debugging responses, and explanations for quality and correctness.
• Check submissions against project guidelines and rubrics, then provide precise, actionable written feedback.
• Evaluate runtime behavior, logic errors, exception handling, algorithmic efficiency, unsafe file/network ops, hallucinated APIs, and non-executable code.
• Identify recurring issues, escalate critical problems, and recommend improvements to contributor training and rubrics.
• Create and maintain onboarding materials, FAQs, examples, trackers, and documentation to raise contributor quality.
• Help keep Python training output executable, idiomatic, clearly explained, and aligned with project expectations.

Requirements

You must meet the required experience and bring strong Python fundamentals; preferred tools and prior AI training experience are listed separately.

• 3+ years of professional Python development, backend engineering, automation, scripting, QA, code review, teaching, or technical mentoring experience.
• Strong understanding of Python fundamentals: data structures, functions, classes, modules, exceptions, comprehensions, iterators, generators, decorators, context managers, packaging, and testing.
• Ability to evaluate content for logic errors, non-executable code, poor exception handling, inefficient algorithms, unsafe operations, hallucinated APIs, and incomplete explanations.
• Clear written communication in English and experience supporting remote teams of trainers, engineers, reviewers, annotators, educators, or QAs preferred.
• Familiarity with pytest, unittest, typing/mypy, pip/poetry/virtualenv, FastAPI/Flask/Django, requests, asyncio, pandas, SQLAlchemy, GitHub, Docker, and CI/CD is preferred but not required.
• Experience with AI training, data annotation, LLM evaluation, code QA, or rubric-based code review is a strong plus.

Schedule, pay, and location

This is a remote contractor position for candidates located in the United States. The expected time commitment is 20+ hours per week.

Compensation is hourly at up to $70/hour (PAY_PER_HOUR, USD). Employment types: contractor, part-time.

• Location: United States only.
• Time requirement: 20+ hours/week.
• Pay: up to $70/hour.

Who should apply and how it works

Apply if you enjoy reviewing code, mentoring contributors, and improving QA processes. This role is a strong fit for senior Python engineers, technical leads, QA specialists, and educators who want flexible, remote contract work that shapes AI training quality.

To apply, create a free OpenTrain account, build a profile showcasing your Python and QA experience, and submit your application to this role. OpenTrain provides the collaboration tools, rubrics, and documentation you'll use to do the work.