Backend Coding Task Creator and AI Evaluator

You will create realistic software tasks for AI systems to solve, then assess whether their solutions are correct, complete, efficient, and maintainable. The work combines backend engineering, code review, debugging, and structured evaluation.

• Create backend feature-development and software bug-fix tasks.
• Build deterministic verifiers that accept reasonable valid solutions and reject incorrect or incomplete implementations.
• Review code for correctness, performance, testing quality, and maintainability.
• Identify software bugs, system bottlenecks, and performance issues in submitted solutions.
• Use engineering judgment to create challenging, high-quality AI training examples.
• Consider debugging, automated testing, and refactoring when evaluating implementations.

What It Pays and Takes

This is a part-time contractor role for people with backend engineering experience and strong technical judgment. The role is listed as entry level, but professional backend development experience is required.

• $30 to $100 per hour equivalent, paid per task that meets the project specifications.
• Less than 20 hours per week.
• Open to candidates in these country codes: AE, AR, AT, BD, BE, BH, BR, CA, CH, CL, CO, DE, DK, DZ, EG, ES, ET, FR, GB, GH, GR, ID, IN, IT, JO, JP, KE, KG, KW, KZ, LB, LK, MA, MX, MY, NG, NL, OM, PE, PH, PK, PS, PT, QA, SA, SG, TH, TN, TW, US, UZ, VN, ZA.
• Professional fluency in English.
• Professional backend development experience with Java, Node.js, Go, Rust, TypeScript, Python, C++, or a similar language.
• Experience building scalable services and APIs.
• Strong knowledge of algorithms, data structures, and foundational computer science.
• Ability to refactor code and implement complex features in large-scale applications.
• Strong analytical, problem-solving, and technical communication skills.
• Experience designing service or feature test strategies, maintaining automated test suites, diagnosing flaky tests, improving testing practices, or maintaining CI test pipelines is helpful.
• Public or private work demonstrating strong software engineering ability is helpful.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training work is the human side of building artificial intelligence. People create examples, review model outputs, and evaluate software solutions so AI systems can learn to perform useful tasks; experienced engineers are needed when the work requires sound technical judgment.

OpenTrain is the hiring and contracting organization for this role. Creating an OpenTrain account is free.