Skip to content
OpenTrain AIFor AI Companies

Language Model Evaluation Expert

Apply now

Job details

Pay

$25 USD/hr

Engagement

Contract, part-time

Location

Remote

Slovenia only

Posted

Aug 15, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting a Slovenian Language Model Evaluation Expert to review AI-generated Slovenian content and create high-quality reference material for AI training. You will improve language-model output by evaluating correctness, fluency, grammar, tone, cultural accuracy, reasoning quality, and adherence to prompts. The role combines linguistic review with reference-answer creation, rewriting, fact-checking, and comparison of multiple model responses.

What you will do
Review Slovenian AI outputs for accuracy, fluency, spelling, grammar, tone, register, cultural appropriateness, and prompt adherence. Identify mistranslations, ambiguity, unnatural phrasing, terminology problems, logical inconsistencies, factual hallucinations, bias, and unsafe or culturally inappropriate language. Provide precise written feedback explaining errors and how to correct them. Create prompts, gold-standard Slovenian answers, rewrites, and model answers across general knowledge, customer support, education, conversational writing, translation, localization, and culturally sensitive content. Rate and rank responses according to correctness, meaning preservation, terminology quality, register consistency, and overall quality.

Required skills
Fluent Slovenian proficiency with strong reading and writing ability. Strong professional English proficiency at a minimum C1 level for following guidelines and providing detailed feedback. Deep knowledge of Slovenian grammar, spelling, punctuation, diacritics, cases, declension, conjugation, dual number, word order, tone, and style. Ability to distinguish formal, neutral, conversational, professional, educational, and public-facing registers. Strong attention to subtle meaning shifts, case endings, agreement, dual-number usage, terminology, and culturally mismatched wording. A bachelor's degree or higher in linguistics, Slovenian language or literature, English literature, communications, journalism, translation, or a related field, or equivalent professional experience. At least three years of relevant professional experience in writing, editing, localization, translation, content QA, journalism, education, or related language-focused work is required.

Helpful background
Experience with AI data training or annotation, translation QA, editorial QA, localization QA, or rubric-based evaluation is helpful.

Schedule, location, and pay
This is a remote hourly contractor role for candidates in Slovenia. OpenTrain estimates a part-time commitment of about 20 hours per week over 1-3 months, with flexible scheduling. The advertised rate is up to $25 per hour.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: Slovenian, English

Open to applicants in

  • Slovenia

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmsu1z2iu002h04lfk2aprtyl

Keep exploring

Similar open roles

View all AI training jobs

ESL Teacher AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $35–$70/hr

Posted Nov 7, 2026

Linguistic Model Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $50–$100/hr

Posted Nov 6, 2026

ML Engineer - LLM & Agentic Evaluations

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonLLM
Text
Remote · Argentina, Belize, Bolivia +20 more
English
Part-time · Flexible

Posted Nov 18, 2026

ML Engineer, LLM and Agentic Evaluations

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonLLM
Text
Remote · India, Pakistan, Türkiye
English
Part-time · Flexible

Posted Nov 18, 2026

Linguistics AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $80/hr

Posted Nov 5, 2026

Browse related job pages