Use your Python and AI engineering experience to evaluate coding-agent trajectories, tool calls, code changes, and technical outcomes. Work worldwide on a flexible 20+ hour-per-week contract through OpenTrain.
Coding & Software
Worldwide
Eligibility
Entry
Experience
Aug 30, 2026
Posted
Open worldwide
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI hires and contracts contributors for specialized projects that help improve modern artificial intelligence systems.
Through OpenTrain, you can build a profile, showcase relevant experience, discover projects that match your skills, and apply in minutes. Creating an OpenTrain account is free.
AI training is the human side of building artificial intelligence. In coding-agent evaluation, experienced engineers examine how AI systems interpret software tasks, use tools, modify code, and respond to execution results.
Your technical judgment helps identify whether an AI coding agent reached a correct outcome, made sound software engineering decisions, and followed an efficient path. This work contributes to the development of next-generation AI systems while offering flexible, remote opportunities in a fast-growing field.
OpenTrain is recruiting a Python Engineer, AI Coding Agent Evaluation contributor to assess complete agentic coding trajectories from the initial prompt through the final output. You will examine prompts, tool calls, intermediate actions, code changes, execution results, and final responses.
The role is listed as entry level, while the required profile includes at least five years of professional software engineering experience and six months to one year of practical AI or LLM engineering experience.
You will analyze coding-agent workflows in detail, combining software engineering judgment with practical validation. The work involves reading, debugging, testing, and validating Python code produced or modified by AI agents.
This role requires strong hands-on Python expertise and the ability to explain whether an AI coding agent's technical outcome is correct. You should be comfortable evaluating both the final code and the sequence of decisions that produced it.
This opportunity is suited to Python engineers who want to apply their software development and AI engineering experience to the evaluation of emerging coding agents. It may be a strong fit if you routinely use tools such as Claude Code, Codex, Cursor, or equivalent systems and can distinguish correct, efficient engineering work from flawed or incomplete approaches.
The project is open worldwide and designed for contributors available to work at least 20 hours per week in a part-time contractor capacity.
AI training and data-labeling work spans coding, language, audio, images, search, and model feedback. Contributors help prepare and review the examples that modern AI systems learn from, making this a direct way to participate in how advanced technology is built.
Apply through OpenTrain to begin building a durable AI training portfolio. Your profile can help you show credible experience, find relevant opportunities, and grow your career in this rapidly expanding industry.
Keep exploring
Evaluate Python coding agents by reviewing trajectories, tool use, code changes, execution results, and final outputs. This remote contractor role offers 20+ hours per week for experienced software engineers with AI or LLM expertise.
Posted Aug 30, 2026
Use your Python engineering expertise to evaluate next-generation coding agents, review complete trajectories, debug generated code, and assess tool use and execution results. Work remotely as a part-time contractor for 20+ hours per week.
Posted Aug 30, 2026
Evaluate next-generation AI coding agents by reviewing their workflows, debugging Python outputs, and validating technical results. This remote contractual role requires expert Python engineering experience and practical experience building or using LLM-powered agents.
Posted Aug 15, 2026
Browse related job pages
Expertise
Languages
