About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Software Engineer, LLM Code Evaluation role focused on creating and assessing software engineering datasets for large language model training and benchmarking. You will review and improve AI-generated code, develop reliable reference solutions, and help evaluate model performance across practical software engineering workflows. The work centers on Python and includes backend services, data pipelines, machine learning infrastructure, full-stack development, and related programming languages.
What you will do
Curate code examples and create precise solutions for model training datasets. Correct and refine AI-generated code for efficiency, scalability, reliability, and code quality. Build Python agents and automated verification tools that identify error patterns and validate solutions. Evaluate model capabilities across prototyping, architecture design, API design, production implementation, monitoring, and operational maintenance. Design verification mechanisms for software engineering tasks and compare results against performance benchmarks. Collaborate with researchers and cross-functional teams on AI-driven coding solutions.
Required skills
At least three years of software engineering experience. Strong Python expertise, including production frameworks, tooling, and best practices. Experience building full-stack applications and deploying scalable software. Strong understanding of software architecture, design, development, debugging, and code review. Ability to write and explain clear, structured evaluation rationales. Working knowledge of JavaScript, ReactJS, C or C++, Java, Rust, or Go is valuable.
Helpful background
Experience building production systems in high-scale engineering environments and a strong computer science foundation are well suited to this work. Practical expertise and demonstrated engineering ability are valued alongside formal education.
Engagement details
This is a remote individual contractor engagement for specialists based in the United States. The engagement requires at least 10 hours per week and allows up to 40 hours per week. The initial duration is one month, with potential extensions based on performance and fit.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.