You will help evaluate AI coding tasks in reproducible coding environments built from real repository code. Your reviews will help assess how well AI systems solve software problems and explain their decisions.
The work combines technical review, evidence-based judgment, and clear documentation. Prior AI training experience is not required.
- Evaluate model outputs using project rubrics.
- Review source materials and model outputs against project guidelines.
- Document evidence that supports each judgment.
- Explain decisions clearly so feedback can improve model behavior.
- Maintain consistent quality across repeated review tasks.