Design realistic backend coding challenges and deterministic verifiers that help evaluate advanced AI systems. Use your software engineering and application security expertise in a flexible, remote contract requiring 20+ hours weekly.
About OpenTrain
OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. Specialists use OpenTrain to discover projects, build a profile, and apply their expertise to work that advances modern AI systems.
- Remote contractor opportunity
- Part-time engagement requiring 20+ hours per week
- Hourly pay ranging from $30 to $100 USD
- English-language work available in the eligible countries listed in the application
About AI Training Work
AI training is the human side of building artificial intelligence. Engineers and subject-matter experts create examples, tests, evaluations, and feedback that help AI systems produce more capable and reliable results. In coding evaluation, this can include realistic programming tasks, solution assessment, debugging scenarios, and secure coding challenges.
- Apply professional judgment to improve advanced AI systems
- Work remotely with flexible part-time scheduling
- Contribute directly to the development of coding and evaluation data
The Role
OpenTrain is seeking a Backend AI Coding Task and Verifier Engineer to create challenging backend programming tasks and deterministic verifiers for assessing solutions. You will design realistic feature implementation and bug-fix scenarios, distinguish reasonable valid solutions from incorrect ones, and incorporate secure coding considerations when relevant.
The role is listed as entry level and requires 20+ hours per week. It is suited to candidates with strong backend development experience, practical software engineering judgment, and the ability to communicate technical decisions clearly.
- Create coding evaluation content for AI training
- Develop deterministic tests and verifiers
- Focus on backend systems, APIs, debugging, and secure implementation
What You'll Do
You will create evaluation tasks that reflect real backend engineering work rather than abstract programming exercises. Your work will help determine whether an AI-generated implementation is functional, maintainable, performant, and appropriately secure.
- Create realistic backend feature implementation and bug-fix tasks
- Build deterministic verifiers that accept valid solutions and reject invalid solutions
- Review code quality, debugging decisions, performance considerations, and automated test coverage
- Apply knowledge of scalable services and APIs
- Evaluate algorithms, data structures, refactoring decisions, and system bottlenecks
- Use security-aware judgment for application security, vulnerability, and secure coding scenarios when applicable
Required Qualifications
You should have strong backend development experience in Java, Node.js, Go, Rust, TypeScript, Python, C++, or a similar language. The work requires a solid foundation in software engineering and computer science, along with the ability to assess implementation quality and correctness.
- Backend development experience in Java, Node.js, Go, Rust, TypeScript, Python, C++, or a similar language
- Experience designing scalable services and APIs
- Experience creating deterministic tests and verifiers for feature implementations and bug fixes
- Comfort debugging performance issues and refactoring codebases
- Experience reviewing code quality and automated test coverage
- Strong understanding of algorithms, data structures, and foundational computer science concepts
- Strong analytical, problem-solving, and technical communication skills
Helpful Application Security Background
Security expertise is valuable for evaluation tasks involving application security and secure coding. Experience in cybersecurity or SecOps can help you create demanding scenarios and identify meaningful vulnerabilities in backend implementations.
- Application security experience
- Penetration testing or vulnerability assessment experience
- Security-focused code review experience
- Knowledge of OWASP or CWE
- Experience refactoring large-scale applications
- Experience implementing complex features
How to Apply
Create a free OpenTrain account and apply through the platform. Include relevant backend engineering, testing, scalability, code review, and application security experience so your technical background is clear.
- Confirm that you can contribute 20+ hours per week
- Be prepared to work in English
- Apply from one of the eligible countries listed for this opportunity
- Use your professional judgment to help improve the capabilities of advanced AI systems