About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting a software engineering contractor to evaluate large language models against realistic coding problems and validate repositories used to create AI training datasets. You will work with public open-source codebases, investigate bug-fixing scenarios, and help produce verifiable software-engineering tasks through hands-on technical review. The work combines practical development, repository quality assessment, and structured evaluation of model performance.
What you will do
Analyze and triage issues across widely used open-source libraries. Configure repositories and development environments, including Docker-based setups. Review unit-test coverage and assess test quality. Modify and run codebases locally to evaluate LLM performance on bug-fixing tasks. Collaborate with researchers to identify repositories and issues that present meaningful challenges for language models. You may also help coordinate junior engineers on project work.
Required skills
You should have strong programming experience in at least one of Python, JavaScript, Java, Go, Rust, C, C++, C#, or Ruby. You should be proficient with Git, Docker, and basic software pipeline setup, and able to understand and navigate complex codebases. Comfort running, modifying, and testing real-world projects locally is required. Experience contributing to or evaluating open-source projects is useful, particularly with well-maintained public repositories.
Helpful background
Previous work in LLM research or evaluation, or experience building and testing developer tools or automation agents, is relevant. Familiarity with widely used public repositories, including repositories with 500 or more stars, is also helpful.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.