Software Engineering Code Evaluation Expert

The work

You will help train and evaluate AI systems that solve software engineering problems. Your work will create clear tests of coding ability and show what a strong technical solution looks like.

You will also review other contributors' code and technical submissions for accuracy, clarity, and sound engineering judgment.

• Create coding problems involving bug fixing, feature development, refactoring, and performance optimization.
• Build reproducible coding environments and reference solutions for evaluation tasks.
• Contribute code samples, debugging methods, and development insights in Python 3, Java, Rust, Go, C++, or TypeScript.
• Analyze software defects and performance bottlenecks.
• Implement reliable features and modernize legacy code.
• Explain technical reasoning clearly in written documentation.
• Review and validate peer-contributed code and technical submissions.

What it pays and takes

This is a part-time remote contractor role. It is listed as entry level, but the work requires substantial real-world software engineering ability. Previous AI training experience is not required.

The role description refers to payment for accepted tasks, while the listed compensation is an hourly range of $50 to $100.

• Pay: $50 to $100 per hour, with compensation tied to accepted tasks.
• Time: Approximately 15 hours per week, or less than 20 hours weekly.
• Location: Remote and available in the countries listed for this role.
• Language: English.
• Programming: Significant hands-on experience in at least one of Python 3, Java, Rust, Go, C++, or TypeScript.
• Technical knowledge: Strong understanding of algorithms, data structures, and software engineering principles.
• Problem solving: Ability to debug complex systems, optimize performance, and refactor large codebases.
• Communication: Ability to explain technical concepts clearly in writing.
• Preferred: Experience delivering features through cross-functional projects.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human work behind systems that write and understand code. Experts create examples, check model answers, and explain what makes a solution correct, so AI systems can improve on real software engineering problems.