Senior Software Engineer, AI Data

You will help evaluate AI coding agents using software codebases, tickets, and AI-generated code outputs. Your reviews will use project rubrics and clear evidence so AI systems can improve.

The work is remote and requires careful, consistent judgment across repeated review tasks.

• Evaluate model outputs against project guidelines and rubrics
• Review source materials, software codebases, tickets, and AI-generated code
• Document evidence-based judgments clearly
• Explain decisions in writing so feedback can improve model behavior
• Maintain consistent quality across review tasks

This is flexible contract work for someone with strong software and written communication skills. Prior AI training experience is not required.

• Time: 20+ hours per week
• Schedule: Flexible scheduling during the ongoing contract
• Language: Fluent in English
• Experience: Relevant professional, academic, or language expertise in AI Coding Agent Evaluation
• Strong written communication and careful attention to detail
• Ability to follow detailed instructions and apply rubrics consistently
• Comfort working independently on remote contractor tasks