About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting a Senior Software Engineer, Coding Agent Evaluation to assess coding agents that perform real engineering work. You will use familiar codebases and realistic software problems to identify where models fail, evaluate the quality of their work, and provide corrections and technical judgment that support the development of stronger coding systems.
What you will do
- Assign coding agents real engineering tickets and review their outputs as you would a teammate's pull request.
- Run submitted code and evaluate whether it solves the task correctly and meets an appropriate engineering standard.
- Pair with an AI agent on a problem from a codebase you know, working through the task step by step.
- Identify, explain, and correct places where the model's implementation or reasoning goes wrong.
- Apply practical software engineering judgment to difficult tasks and communicate where model performance falls short.
Required skills
- At least four years of professional software engineering experience.
- A bachelor's or master's degree in computer science or a related field.
- Strong written English and the ability to explain technical decisions clearly.
- US work authorization.
- Availability for 40 hours per week during the contract.
Helpful background
Prior AI experience is not required. The key qualification is strong software engineering ability, including the judgment to run code, review implementations, diagnose defects, and determine whether a solution meets the requirements of a real ticket.
Compensation and schedule
The contract pays $6,000 per 40-hour week, equivalent to $150 per hour, with weekly payment. You can set your schedule and work remotely from within the United States. The contract renews weekly while quality standards are met. Additional hours may be approved for exceptional performance and are paid at $150 per hour. The work is ongoing rather than limited to a short project.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.