About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a software engineering contractor to work on building and evaluating LLM datasets. In this role you will create verifiable software engineering tasks based on public repository histories, triage GitHub issues, set up development environments, and evaluate LLM performance on real code problems. You will collaborate with researchers to design tasks that push the boundaries of LLM code understanding.
What you will do
- Analyze and triage GitHub issues across trending open-source libraries
- Set up and configure code repositories including Dockerization and environment setup
- Evaluate unit test coverage and quality
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios
- Collaborate with researchers to identify repositories and issues that are challenging for LLMs
- Opportunity to lead a team of junior engineers
Required skills
- Minimum 3+ years of overall software engineering experience
- Strong experience with C++
- Proficiency with Git, Docker, and basic software pipeline setup
- Ability to understand and navigate complex codebases
- Comfortable running, modifying, and testing real-world projects locally
- Experience contributing to or evaluating open-source projects is a plus
Helpful background
- Previous participation in LLM research or evaluation projects
- Experience building or testing developer tools or automation agents
Why join OpenTrain
- Fully remote work environment
- Flexible time commitment options: 20, 30, or 40 hours per week
- Build experience at the forefront of LLM evaluation and AI training data creation