AI Trainer (Software Engineering)

You will help train and evaluate advanced AI systems by creating realistic software engineering problems and reviewing the code they produce. Your work will turn practical engineering judgment into clear tasks, tests, reference solutions, and evaluation standards.

• Create demanding software engineering tasks for AI model evaluation.
• Write task instructions and define objective standards for correct solutions.
• Build reproducible environments, reference solutions, tests, and evaluation criteria.
• Review generated code and technical deliverables for correctness, robustness, completeness, and reproducibility.
• Find problems with implementation, debugging, dependencies, performance, testing, and environment setup.
• Contribute technical judgment to coding evaluations and benchmark-style tasks.

This is a fully remote, part-time contractor role focused on accepted task deliverables. Task availability and completion time may vary.

• Time: Less than 20 hours per week.
• Language: Fluent in English.
• Experience: Expert-level software engineering ability and prior paid experience training, evaluating, benchmarking, or improving AI systems.
• Technical skills: Strong practical proficiency with Python and professional experience with another language such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
• Required knowledge: Software design, debugging, testing, version control, and dependency management.