You will help develop and evaluate AI agents through backend software work, quality checks, task creation, and model-focused evaluation. You may focus on building connectors that replicate software tools, developing realistic long-horizon tasks, or contributing across both tracks.
- Build Python backend applications that replicate collaboration, project management, email, documentation, and workflow systems.
- Extend existing connectors and create new connectors within agreed timeframes.
- Test and validate connector behavior against the systems being emulated.
- Study workflows and data to identify opportunities for long-horizon task development.
- Write realistic tasks and assess their quality, realism, and correctness.
- Create evaluation rubrics covering correct, partially correct, and deficient work.
- Take part in calibration and quality reviews while meeting agreed quality milestones.
What it pays and takes
This is a remote contractor engagement with a four-week term starting immediately. The work is marked entry level, but the requirements include at least three years of backend development experience.
- $300 per approved task.
- At least 20 hours per week.
- Complete at least one approved task per day, with no stated cap on the number of tasks.
- Remote work open worldwide.
- Professional fluency in English.
- At least three years of backend development experience.
- Strong Python skills with FastAPI, Flask, or Django.
- Experience building scalable backends, REST APIs, and microservices.
- Working knowledge of Git, Docker, pipelines, testing, and code-quality practices.
- Daily experience using AI coding assistants such as Claude Code, Codex, Cursor, GitHub Copilot, or similar tools.
- Ability to make precise judgments about software behavior, task realism, correctness, and quality standards.
- Experience with integrations, third-party workflow emulation, evaluation criteria, or AI agent development is helpful.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work is the human side of building artificial intelligence. People create examples, test software behavior, and judge model results so AI systems can perform useful tasks more reliably; experienced contributors are needed when the work requires strong technical judgment.