You will turn practical machine learning experience into technical tasks that test advanced AI systems. The work includes designing tasks, preparing reproducible environments and reference solutions, and judging whether model-generated technical work is correct and reliable.
- Create realistic machine learning engineering tasks for advanced AI systems.
- Build reproducible environments, reference solutions, evaluation criteria, rubrics, and graders.
- Review model-generated Python code, experiments, analyses, and other technical deliverables.
- Identify data leakage, incorrect validation, unstable training, performance problems, and reproducibility issues.
- Assess technical submissions against clear project specifications and quality requirements.