You will lead security-focused training and evaluation work for AI coding models. The role covers delivery, quality, staffing, technical review, and communication across multiple pods.
- Plan work batches, assign tasks to Pod Leads, and track progress against delivery targets.
- Serve as the final quality reviewer for security tasks, including CWE classification, task difficulty, and verifier strength.
- Check that vulnerability tasks are technically accurate, reproducible, and resistant to gaming.
- Review vulnerability reproductions, security patches, proof-of-vulnerability tests, automated tests, and technical evaluation environments.
- Monitor volume, quality, schedules, risks, dependencies, tooling issues, rate limits, and safety blocks.
- Report progress, coordinate changes in scope and delivery, and use dashboards and operational metrics to guide decisions.
- Forecast staffing needs from throughput and workload data.
- Mentor technical contributors and help prepare strong team members for Pod Lead responsibilities.