Open-Source Code Reviewer (Python)

You will review public Python repositories and software issues to support AI evaluation. The work focuses on assessing code quality and how well language models handle realistic bug-fixing tasks.

You will work with real codebases locally and help identify repositories and issues that create useful engineering challenges for AI models.

• Analyze and triage GitHub issues across open-source Python libraries.
• Set up repositories and Docker-based development environments.
• Review unit-test coverage and software quality.
• Run and modify code locally to evaluate bug-fixing performance.
• Work with researchers to identify meaningful coding tasks for language models.

• Schedule: 20 or more hours per week.
• Assignment length: Expected to last four weeks.
• Time overlap: Four hours of overlap with Pacific Time.
• Language: Professional fluency in English.
• Experience: At least two years of software engineering experience.
• Skills: Strong Python, Git, Docker, and basic software pipeline setup skills.
• You should be comfortable navigating complex codebases and running, modifying, and testing projects locally.