About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a senior software engineer contract role focused on LLM evaluation and repository validation. You will build and evaluate verifiable software engineering tasks from public GitHub repositories, contributing to LLM training datasets. This is hands-on work analyzing open-source code, triaging issues, and assessing how well LLMs perform on real-world bug-fixing and software development scenarios.
What you will do
- Analyze and triage GitHub issues across trending open-source libraries
- Set up and configure code repositories, including Dockerization and environment setup
- Evaluate unit test coverage and quality
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs
- Lead a team of junior engineers on collaborative projects
Required skills
- Minimum 3+ years of overall software engineering experience
- Strong experience with Ruby
- Proficiency with Git, Docker, and basic software pipeline setup
- Ability to understand and navigate complex codebases
- Comfortable running, modifying, and testing real-world projects locally
Helpful background
- Experience contributing to or evaluating open-source projects
- Previous participation in LLM research or evaluation projects
- Experience building or testing developer tools or automation agents
Contractor details
This is a remote contractor assignment. You must commit to at least 20 hours per week, with a 4-hour overlap with PST. Options of 20, 30, or 40 hours per week are available. Location is restricted to India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, and Mexico.