Skip to content
OpenTrain AIFor AI Companies

AI Evaluator

Apply now

Job details

Pay

$35 USD/hr

Engagement

Contract, part-time

Location

Remote

Estonia only

Posted

Aug 15, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting an Estonian Language AI Evaluator to review AI-generated Estonian content and create high-quality language data for model improvement. You will assess responses for accuracy, fluency, grammatical correctness, cultural appropriateness, logical consistency, and alignment with the requested prompt. The work combines expert language judgment with written feedback, comparative evaluation, and creation of reference answers across general knowledge, education, customer support, translation, localization, conversational writing, and culturally sensitive content.

What you will do
You will review AI-generated Estonian text for grammar, spelling, fluency, meaning, terminology, tone, register, and cultural fit. You will identify mistranslations, ambiguity, unnatural phrasing, incorrect case forms, factual hallucinations, bias, unsafe content, and policy-risk language. You will create prompts, gold-standard Estonian answers, rewrites, and model responses that demonstrate clear and natural writing. You will rate and compare multiple AI responses using criteria such as correctness, meaning preservation, structure, safety, tone, and overall quality. When needed, you will fact-check claims and provide precise written explanations of errors and recommended improvements.

Required skills
You must have fluent Estonian proficiency with strong reading and writing ability, along with strong professional English proficiency at minimum C1 for following guidelines and providing detailed feedback. You should have deep knowledge of Estonian grammar, spelling, punctuation, cases, word order, compound words, verb forms, tone, and style. The role requires the ability to distinguish formal, neutral, conversational, professional, educational, and public-facing registers, as well as strong attention to subtle meaning shifts, literal translations, terminology problems, culturally mismatched wording, and language interference.

Helpful background
A bachelor's degree or higher in linguistics, Estonian language or literature, English literature, communications, journalism, translation, or a related field is helpful, as is equivalent professional experience. At least three years of experience in writing, editing, localization, translation, content quality assurance, journalism, education, or another language-focused discipline is expected. Experience with AI data training, translation quality assurance, editorial quality assurance, localization quality assurance, or rubric-based evaluation is preferred.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: Estonian, English

Open to applicants in

  • Estonia

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmsu1z25a002904lfb0v0ubbz

Keep exploring

Similar open roles

View all AI training jobs

Community Association Manager, AI Evaluation

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

Critical ThinkingCommunicationProblem Solving
Text
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 18, 2026

Applied AI Agent Evaluation Research Engineer

About OpenTrain. OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and develop a durable freelance career. We help ca…

AI Agent Evaluation & Benchmark DesignPython & Research EngineeringAgent Failure Analysis & ExperimentationLLM & Agentic Systems
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $96.15–$125/hr

Posted Nov 17, 2026

Career and Technical Education AI Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $75/hr

Posted Nov 7, 2026

Energy Project Estimation AI Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $85/hr

Posted Nov 5, 2026

AI Product Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

AI ModelsAI AgentsFollowing InstructionsAttention to Detail
Text
Remote · United Kingdom, India, Japan
English
Part-time · Flexible
Hourly · $14–$36/hr

Posted Oct 16, 2026

Browse related job pages