Carol M.

Key Skills

Software

Labelbox

Scale AI

Prodigy

Top Subject Matter

LLM output ranking

prompt engineering

adversarial safety testing

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Classification

Entity (NER) Classification

Freelancer Overview

Senior AI Content Specialist. Core strengths include Labelbox, Scale AI, and Prodigy. AI-training focus includes data types such as Text and labeling workflows including RLHF, Classification, and Entity (NER) Classification.

Labeling Experience

Senior AI Content Specialist

LabelboxTextRLHF

As a Senior AI Content Specialist, I performed RLHF to rank and refine model outputs for accuracy, safety, and fluency. I led complex prompt engineering and red-teaming initiatives to push model boundaries and ensure comprehensive labeling guidelines. Coordination with a team of annotators ensured over 500,000 monthly data points met gold-standard annotation criteria. • Utilized advanced prompt engineering to test models in coding, logic, and creative domains. • Developed label taxonomies and quality benchmarks for large-scale data projects. • Executed adversarial testing for bias detection and mitigation. • Oversaw quality control processes to maintain consistency and accuracy.

2023 - Present

Data Labeling Lead

Scale AITextClassification

As Data Labeling Lead, I supervised annotation projects in computer vision and NLP domains, creating workflows for multi-modal data. I customized labeling taxonomies for industry-specific datasets and improved efficiency through automation. Systematic QA reviews maintained near-perfect accuracy for training sets. • Oversaw team-based annotation for legal, medical, and technical data. • Developed pre-labeling automation scripts. • Conducted final audits of complex data labels. • Ensured datasets matched standards for SFT and other model training tasks.

2020 - 2022

Content Analyst & Data Evaluator

ProdigyTextEntity (NER) Classification

As a freelance Content Analyst & Data Evaluator, I focused on SME labeling for technical LLM use cases. I refined datasets for chatbot and virtual assistant training, emphasizing NLU and dialog retention. I also authored edge-case data to enhance model handling of nuanced interactions. • Labeled conversational data for context and intent. • Provided expert annotation for industry-specific datasets. • Wrote specialized prompts for human-like response modeling. • Supported data curation for NLU improvement.

2018 - 2020