About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Senior Software Engineer, LLM Code Evaluation role focused on creating and refining code datasets for large language model training and benchmarking. You will review AI-generated software, develop precise solutions, correct errors, and assess whether implementations meet standards for efficiency, scalability, reliability, and production quality. The work spans backend services, data pipelines, ML infrastructure, and broader software engineering workflows.
What you will do
You will curate code examples and build high-quality solutions for model training datasets. You will evaluate and refine AI-generated code for correctness, efficiency, scalability, and reliability. You will create Python agents and automated verification tools that identify error patterns and validate software solutions. You will assess model capabilities across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and operational maintenance. You will collaborate on AI-driven coding solutions using relevant industry performance benchmarks.
Required skills
You should have at least three years of software engineering experience, deep Python expertise including production frameworks, tooling, and best practices, and experience building full-stack applications and deploying scalable software. Strong knowledge of software architecture, design, development, debugging, and code review is required. You should be able to provide clear, structured evaluation rationales. Familiarity with JavaScript and ReactJS, C/C++, Java, Rust, or Go is relevant to the work.
Engagement
This contractor engagement offers a flexible commitment of 10 to 40 hours per week and is planned for one month, with potential extensions based on performance and fit. Candidates must be based in the United States.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.