Olivia M.

Key Skills

Software

Other

Internal/Proprietary Tooling

Top Subject Matter

Large Language Model (LLM) training

Safety Domain Expertise

and evaluation

Top Data Types

Text

Document

Image

Audio

Top Task Types

Evaluation/Rating

RLHF

Freelancer Overview

AI Data Annotator (LLM training, RLHF, evaluation, and red-teaming) — Avance/Centific. Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Other. Education includes Bachelor of Arts, University of the Incarnate Word (2013). AI-training focus includes data types such as Text and labeling workflows including RLHF.

Labeling Experience

AI Data Annotator

OtherTextEvaluation/RatingRLHF

Trained and fine-tuned LLMs using Reinforcement Learning from Human Feedback (RLHF) in partnership with leading AI research labs. Refined model behavior to reduce toxicity, improve factual accuracy, and enhance creative writing quality. Evaluated AI outputs for accuracy, safety, and instruction-following to consistently achieve a rigorous quality score above 95%. • Labeled and assessed AI-generated code and prose for correctness and safety. • Designed and authored red-teaming prompts to probe model limitations. • Identified potential vulnerabilities such as bias and hate speech through adversarial testing. • Measured and reported performance using quality metrics to ensure annotation standards were met.

2025 - 2025

Education

Work History