About OpenTrain
OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freelance career. We help candidates discover high-quality AI training, evaluation, and data work without scattering their track record across disconnected sites.
About this role
OpenTrain is recruiting for a Java LLM Code Evaluation Engineer to support AI training work focused on Java LLM Code Evaluation. This role uses Public Java repositories, GitHub issues, and unit-test codebases so AI systems can learn from structured human expertise, careful review, and clear written feedback. Prior AI training experience is not required unless stated elsewhere on this job page; the most important qualification is strong real-world knowledge of the subject area.
What you will do
- evaluate model outputs, apply project rubrics, and document evidence-based judgments
- Review source materials and model outputs against project guidelines
- Explain judgments clearly so the feedback can improve model behavior
- Maintain consistency and quality across repeated review tasks
Required skills
- Minimum 3+ years of overall experience
- Strong experience with at least one of the following languages: Java
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
Helpful background
- Experience contributing to or evaluating open-source projects is a plus.
- Previous participation in LLM research or evaluation projects.
- Experience building or testing developer tools or automation agents.
Schedule and pay
This is a fully remote contractor assignment requiring at least 40 hours per week, including at least four hours per day and four hours of overlap with PST.
Compensation is handled through the OpenTrain project budget fields shown on this job page.
Why work with OpenTrain
OpenTrain gives freelancers one place to find AI training work, build a unified AI training portfolio, and use that work history to qualify for more opportunities over time. For domain experts, language specialists, writers, engineers, and reviewers, AI training is a growing market where specialized judgment can become a flexible and repeatable source of income.