Skip to content
OpenTrain AIFor AI Companies

AI Evaluator

Apply now

Job details

Pay

$15–$40 USD/hr

Engagement

Contract, part-time

Location

Remote

United States only

Posted

Oct 8, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for an English Language AI Evaluator to help improve AI assistant quality through realistic teaching-related task evaluation. You will use AI assistant tools to handle scenarios involving student and parent communication, scheduling, educational event coordination, and collaboration with colleagues. You will then assess whether the assistant's work is accurate, complete, grammatically sound, audience-appropriate, and faithful to detailed instructions. The role combines classroom experience with literary, rhetorical, and composition expertise to evaluate how AI-generated writing performs in everyday educational contexts.

What you will do
Complete standardized digital tasks based on real-world English teaching and classroom coordination scenarios. Give AI assistants precise instructions for multi-step tasks and review the resulting work carefully. Evaluate, rank, and annotate assistant responses using detailed grading guidelines. Judge language quality, grammar, tone, clarity, literary appropriateness, and adherence to requested details. Record findings and submit evaluation data using AI training tools and platforms.

Required skills
Experience teaching English or literature in K-12, college, adult education, or ESL settings. A bachelor's degree in English, literature, creative writing, linguistics, comparative literature, education, or a related humanities field. Strong command of grammar, writing conventions, literary analysis, rhetoric, and composition. Careful instruction following, especially for detailed multi-step guidelines and evaluation criteria. Daily hands-on use of Google Classroom, with regular use of Gmail and Google Calendar for teaching-related work. Practical experience using AI tools and reviewing AI-generated writing for accuracy, tone, and completeness. Residence in the United States, an iPhone with iMessage, and a Facebook and/or Instagram account.

Helpful background
A master's degree or advanced coursework in English, literature, or a related field. Experience with AI evaluation, data labeling, user testing, structured feedback, or rubric development. Familiarity with prompt writing and the behavior and limitations of AI assistants.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

Requirements

  • Languages: English
  • Skills: English, Attention to Detail, AI Usage, Google Classroom, Literature

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmuyruhws000406ju6l6qtwto

Keep exploring

Similar open roles

View all AI training jobs

Coding Agent Evaluation Researcher

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

LLMsCoding EvaluationAI EvaluationML Systems
Code
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $86.54–$125/hr

Posted Nov 18, 2026

Applied AI Agent Evaluation Research Engineer

About OpenTrain. OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and develop a durable freelance career. We help ca…

AI Agent Evaluation & Benchmark DesignPython & Research EngineeringAgent Failure Analysis & ExperimentationLLM & Agentic Systems
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $96.15–$125/hr

Posted Nov 17, 2026

Career and Technical Education AI Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $75/hr

Posted Nov 7, 2026

Energy Project Estimation AI Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $85/hr

Posted Nov 5, 2026

Community Association Manager, AI Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

Critical ThinkingCommunicationProblem Solving
Text
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 18, 2026