Anna F.

Key Skills

Software

OneForma

Other

Top Subject Matter

Multimodal LLM linguistic evaluation and RLHF-style preference training for Russian

Acceptability and MTPE quality assessment for English-to-Russian datasets (ISAAC framework)

AI training dataset construction

Top Data Types

Text

Document

Audio

Top Task Types

RLHF

Freelancer Overview

Lilt | AI Language Expert Project: ESPL (Expert Scaled Prompt & Language) – Pilot Phase. Brings 21+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include OneForma and Other. AI-training focus includes data types such as Text and Document and labeling workflows including RLHF, Translation, and Localization.

Labeling Experience

Lilt | AI Language Expert Project: ESPL (Expert Scaled Prompt & Language) – Pilot Phase

OneFormaTextRLHF

Provided multimodal LLM linguistic evaluation and training contributions for Russian language Speaking and Listening tasks during a pilot phase. Performed preference triad ranking and created error rewrites to generate high-quality golden responses with accompanying rationales in English for engineering feedback. Supported development and refinement of linguistic evaluation guidelines for multimodal model performance. • Evaluated AI outputs in Speaking and Listening categories • Ranked preference triads (HHH) and produced golden responses • Wrote detailed English rationales for linguistic adjustments • Used OneForma workflows for pilot training and assessment

2024

OneForma (Centific) | Linguistic Quality Evaluator Projects: ISAAC Framework (Acceptability Tasks & MTPE)

OneFormaText

Delivered high-volume acceptability and translation evaluation work for English (US/UK) to Russian (RU) datasets under the ISAAC framework. Executed MTPE and acceptability tasks to ensure outputs met professional-grade benchmarks within OneForma platform workflows. Focused on quality labeling and endurance in complex dataset labeling processes. • Performed Acceptability Tasks (ISAAC) • Executed MTPE for English-to-Russian localization • Conducted quality checks against professional benchmarks • Managed high-volume dataset labeling in OneForma

2023

Senior AI Content Specialist & Localization Expert | Datamundi (Summa Linguae Technologies)

OtherDocument

Built and refined AI training datasets through linguistic data mining and structured analysis of online resources and complex PDF documentation. Performed linguistic quality assurance by detecting overliteral translations and flagging unidiomatic expressions to improve natural Russian output. Conducted contextual reasoning for terminology applicability to ensure semantic accuracy in specialized domains. • Performed overliteral translation detection and correction • Evaluated terminology using semantic context and polysemy resolution • Mined and analyzed online/PDF sources for dataset development • Provided localization QA aligned to brand terminology and complex style guides

2019

Work History