Language Model Evaluation Expert

You will review AI-generated Slovenian content and create reference material used to improve language models. Your work will cover general knowledge, customer support, education, conversation, translation, localization, and culturally sensitive content.

You will explain language and reasoning problems clearly, rewrite responses, fact-check claims, and compare multiple answers. You will also create prompts, high-quality Slovenian answers, and ratings based on accuracy, meaning, terminology, register, and overall quality.

• Review Slovenian AI outputs for grammar, spelling, fluency, tone, register, cultural fit, and prompt adherence.
• Find mistranslations, unclear wording, terminology problems, logical errors, factual hallucinations, bias, and unsafe or inappropriate language.
• Write detailed feedback that explains errors and how to correct them.
• Create prompts, reference answers, rewrites, and model answers in several content areas.
• Rate and rank responses using project guidelines.

Scheduling is flexible, and the project is expected to run for about one to three months.

• Schedule: About 20 hours per week, with flexible scheduling.
• Languages: Fluent Slovenian and professional English proficiency at C1 level or higher.
• Language knowledge: Strong command of Slovenian grammar, spelling, punctuation, diacritics, cases, declension, conjugation, dual number, word order, tone, and style.
• Register skills: Ability to distinguish formal, neutral, conversational, professional, educational, and public-facing language.
• Education or equivalent experience: A bachelor's degree or higher in linguistics, Slovenian language or literature, English literature, communications, journalism, translation, or a related field, or equivalent professional experience.
• Experience: At least three years in writing, editing, localization, translation, content quality assurance, journalism, education, or related language-focused work.