Build Python backends, SaaS connectors, and evaluation rubrics that help measure AI agent performance. This flexible contract role requires 20+ hours weekly, strong backend experience, and daily use of AI coding assistants.
About OpenTrain
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is recruiting contractors for practical work that helps develop, test, and evaluate the systems behind modern artificial intelligence.
Create a free OpenTrain account to build your profile, showcase relevant experience, and apply for AI training opportunities in one place.
About AI Training and Agent Evaluation
AI training is the human side of building artificial intelligence. People contribute by preparing examples, reviewing outputs, writing evaluation criteria, and testing whether AI systems behave accurately and reliably.
In this role, your software engineering and quality-review work will support AI agent infrastructure and training data development. You will help define realistic tasks and assess how well AI agents complete them.
The Role
OpenTrain is seeking a Python Backend AI Agent Infrastructure Engineer for flexible contract work supporting backend development, SaaS connector validation, long-horizon task creation, and AI agent evaluation.
The role combines hands-on Python engineering with structured quality assurance. Depending on the assignment, you may reproduce the behavior of familiar SaaS tools or create realistic tasks and rubrics used to assess AI agent performance.
The listing identifies this opportunity as entry level, while the requirements call for at least three years of backend development experience.
- Contractor and part-time opportunity
- Worldwide remote availability
- 20+ hours per week
- English-language work
- Compensation listed as $300 USD per completed label
What You'll Do
You will build, test, and review backend systems and evaluation materials against agreed milestones. Careful documentation, realistic task design, and consistent quality judgments are central to the work.
- Build Python backend applications that reproduce the behavior of tools such as Slack, Linear, Jira, Notion, Gmail, and internal wikis.
- Test connectors for faithful behavior and extend existing implementations.
- Deliver new connectors within agreed timeframes.
- Mine workflows and data to identify candidates for long-horizon task development.
- Author realistic tasks for AI agent evaluation.
- Verify task quality, realism, and correctness through structured quality assurance.
- Write rubrics that distinguish correct, partially correct, and deficient work.
- Participate in calibration and quality reviews.
- Use AI coding assistants carefully across development, validation, and quality assurance.
Required Experience and Skills
You should be comfortable building production-oriented backend systems and evaluating software behavior in a structured way. The role requires practical experience with Python frameworks, modern development workflows, and AI-assisted coding.
- At least 3 years of backend development experience.
- Strong Python development experience with FastAPI, Flask, or Django.
- Experience building scalable backends, REST APIs, and microservices.
- Working knowledge of Git, Docker, pipelines, testing, and code-quality practices.
- Daily experience using AI coding assistants such as Claude Code, Codex, Cursor, or GitHub Copilot.
- Ability to build and validate SaaS connectors or author realistic long-horizon tasks and evaluation rubrics for AI agent work.
- Ability to apply AI coding assistants carefully across development, quality assurance, and validation.
Who Should Apply
This opportunity may suit backend engineers who want to apply their development skills to the rapidly growing AI training industry. It is especially relevant if you enjoy reproducing software behavior, investigating workflows, designing tests, and making precise judgments about technical quality.
Strong attention to detail matters because the work must distinguish fully correct, partially correct, and deficient agent behavior. You should also be prepared to collaborate through calibration and quality reviews while meeting agreed milestones.
Build Your AI Training Career with OpenTrain
AI training and data-labeling work gives technical professionals a way to contribute directly to how advanced AI systems are developed. OpenTrain helps you build a durable profile, show credible experience, discover relevant projects, and grow your career in this fast-moving field.
Create your free OpenTrain account and apply for this Python backend opportunity when you are ready.