About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Java developer to support large language model training, evaluation, and improvement. You will combine software development with hands-on AI data work by building reliable backend components, assessing model responses, creating task-specific datasets, and refining outputs for clarity, relevance, technical accuracy, and alignment with defined standards.
What you will do
Design, develop, and maintain efficient Java and backend code used to train and optimize AI models
Conduct model evaluations to benchmark performance and analyze results for continuous improvement
Evaluate and rank responses to user queries across diverse domains using predefined criteria
Write clear explanations and rationales that show sound reasoning and technical judgment
Create and maintain high-quality datasets for supervised fine-tuning
Collaborate with researchers and annotators on reinforcement learning with human feedback and reward-model improvement
Develop evaluation strategies that support user needs and ethical model behavior
Create and refine model responses while reviewing code and documentation for quality
Required skills
Proficiency with Java syntax, conventions, and modern coding practices
Experience developing modular web applications with scalable architectures
Ability to produce clean, organized, correct, and clearly annotated code
Strong understanding of code readability, security, stability, and testing
Excellent spoken and written English communication
Ability to evaluate technical responses against explicit quality criteria and explain decisions clearly
Bachelor's or master's degree in engineering or computer science, or equivalent experience
Helpful background
Prior software quality assurance and test-planning experience is useful for assessing implementation quality and designing reliable evaluation processes. Experience working with large language models, supervised fine-tuning, reinforcement learning with human feedback, or model evaluations is also relevant to the responsibilities of this role. This is a remote contractor opportunity supporting AI projects.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.