Skip to content
OpenTrain AIFor AI Companies

Remote AI Code Evaluator jobs

AI code evaluator roles are AI training work for people who can read and judge code. Each open role below has its own page with the work, the requirements and the pay where listed.

  • 100% remote
  • Flexible hours
  • Hourly / per-task pay
  • 22 open roles

Open AI Code Evaluator roles

22 open roles

Hourly pay on these roles, where listed: $50–$280/hr

Software Engineering AI Response Evaluator

Review AI-generated software engineering answers for accuracy, feasibility, and production quality. This US-based contract role pays $120 per hour and offers 20 or more flexible hours each week.

Coding & Software
Text
Remote · United States
English
Part-time · Flexible
Entry level
Hourly · $120/hr

Posted Sep 30, 2026

Code Quality Engineer for LLM Evaluation

Review AI-generated code for correctness, security, reliability, and maintainability in LLM evaluation work. This remote contract role requires at least seven years of software engineering experience and 20+ hours per week.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Sep 30, 2026

Software Engineering AI Evaluation Specialist

Evaluate how well AI systems handle real software engineering and bug-fixing tasks. Prepare open-source repositories, test code locally, and build rigorous coding evaluation scenarios.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Sep 22, 2026

Python Software Engineering LLM Evaluator

Evaluate how language models handle real Python repositories, software bugs, and tests. This remote three-month contractor assignment pays $100 per task and requires 20+ hours per week.

Coding & Software
Computer Code Programming
Remote · India, Pakistan, Nigeria +5 more
English
Part-time · Flexible
Entry level
Per task · $100/label

Posted Sep 21, 2026

Full-Stack Engineer

Review AI-generated code and solve full-stack software tasks for $50 to $100 per hour equivalent, paid per task that meets the project specifications. Work part time, for less than 20 hours per week, with applications completed through OpenTrain and the hiring site.

Coding & Software
Computer Code Programming
Remote · Mexico, Philippines, United States
English
Part-time · Flexible
Mid-Senior level
Per task · $50–$100/hr equivalent

Posted Sep 16, 2026

Code Generation And Model Evaluation Engineer

Review and improve AI-generated code, create coding tests, and evaluate model performance across several programming languages. This remote contractor role offers $50 to $100 per hour equivalent, paid per task that meets the project specifications, for less than 20 hours per week.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +50 more
English
Part-time · Flexible
Entry level
Per task · $50–$100/hr equivalent

Posted Sep 14, 2026

Problem Solver

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Computer Code Programming
Remote · India, United States
English
Part-time · Flexible
Mid-Senior level
Per task · $50–$80/hr equivalent

Posted Sep 11, 2026

Software Engineering AI Evaluation Specialist

Create coding environments and reference solutions that test AI models on difficult software engineering tasks. This part-time contractor role requires less than 20 hours per week and pays $50 to $100 per hour equivalent, paid per task.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +50 more
English
Part-time · Flexible
Mid-Senior level
Per task · $50–$100/hr equivalent

Posted Sep 7, 2026

Senior Software Engineer

Review AI-generated code, coding problems, solutions, and test cases while helping improve software engineering AI systems. This remote contractor role pays $245 to $280 per hour and requires strong software engineering judgment.

Coding & Software
Computer Code Programming
Remote · India, United States
English
Part-time · Flexible
Mid-Senior level
Hourly · $245–$280/hr

Posted Aug 27, 2026

Software Engineering AI Evaluation Specialist

Evaluate AI-generated software work in realistic developer environments for $50 to $70 per hour as a contractor. Use Git, CI/CD, Python, APIs, and technical judgment to assess model behavior.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +50 more
English
Part-time · Flexible
Entry level
Hourly · $50–$70/hr

Posted Aug 19, 2026

C# Software Engineer, LLM Code Evaluation

Evaluate how language models fix real software bugs using C#, GitHub repositories, Docker, and unit tests. This remote contractor role requires at least three years of software engineering experience and 20 or more hours per week.

Coding & Software
Computer Code Programming
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible
Entry level

Posted Jul 20, 2026

Ruby Software Engineer for LLM Evaluation

Evaluate how well LLMs solve real software engineering tasks using Ruby and open-source codebases. This remote contractor role requires 20 or more hours weekly and four hours of PST overlap.

Coding & Software
Text
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible
Entry level

Posted Jul 20, 2026

AI Code Evaluation and Benchmarking Engineer

Review and benchmark AI-generated software on a remote, one-month US contractor assignment. Use your software engineering experience to test code, assess explanations, and improve coding evaluation standards.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible
Entry level

Posted Jul 17, 2026

C++ AI Code Evaluation Developer

Review and improve AI-generated C and C++ code, solve difficult programming problems, and help build backend components for language model training. This contract role requires 20 or more hours each week and strong English communication.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Jul 17, 2026

Senior LLM Code Evaluation Engineer

Evaluate how language models work with real software repositories, from GitHub issue triage to local testing and bug-fixing tasks. This contract role needs strong Go skills, 3+ years of engineering experience, and 20+ hours each week.

Coding & Software
Computer Code Programming
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible
Entry level

Posted Jul 17, 2026

C++ LLM Evaluation Software Engineer

Evaluate how well large language models solve real C++ software problems. Build code tasks from open-source projects, test repositories locally, and work remotely for 20 or more hours each week.

Coding & Software
Computer Code Programming
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible
Entry level

Posted Jul 17, 2026

AI Coding Evaluation And Training Developer

Help train and evaluate AI coding models with Python, JavaScript or TypeScript, response ranking, dataset creation, and RLHF. This worldwide contractor role requires 20+ hours per week and strong English.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Jul 17, 2026

LLM Code Evaluation Software Engineer

Review and improve AI-generated code, create coding datasets, and build tools that verify software solutions. This flexible contractor role is open to experienced engineers in the US, Canada, and selected Western European countries.

Coding & Software
Computer Code Programming
Remote · United States, Canada, Austria +3 more
English
Part-time · Flexible
Entry level

Posted Jul 16, 2026

Senior Python Engineer for LLM Evaluation

Use Python, Git, and Docker to test real software projects and evaluate how well language models fix bugs. This contractor role requires 20+ hours weekly and is open to English speakers in nine countries.

Coding & Software
Computer Code Programming
Remote · India, Pakistan, Nigeria +6 more
English
Part-time · Flexible
Entry level

Posted Jul 16, 2026

Software Engineering LLM Evaluator

Review and improve AI-generated code across major programming languages, from design through production operations. This flexible contractor role requires strong software engineering experience and partial PST availability.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Jul 16, 2026

LLM Code Evaluation Engineer

Evaluate large language models on real coding problems, inspect open-source repositories, and test bug-fixing tasks locally. This contract role is open worldwide, requires English, and offers 20 or more hours per week.

Coding & Software
Computer Code Programming
Remote · Worldwide
English
Part-time · Flexible
Entry level

Posted Jul 16, 2026

Full-Stack Code Evaluation Engineer

Review AI-generated full-stack code, system designs, and technical explanations using Node.js, React, and TypeScript. This remote contractor role offers $60 to $100 per hour, requires 20+ hours weekly, and is open in Germany, India, and the United States.

Coding & Software
Computer Code Programming
Remote · Germany, India, United States
English
Part-time · Flexible
Entry level
Hourly · $60–$100/hr

Posted Jul 8, 2026

Create a free OpenTrain account to apply and get matched to future roles.

Create a free account