Stewart

Key Skills

Software

Scale AI

Appen

Lionbridge

Top Subject Matter

AI Safety

Nlp Domain Expertise

Model Evaluation

Top Data Types

Text

Audio

Image

Document

Top Task Types

RLHF

Transcription

Freelancer Overview

Lead AI Evaluator & Data Annotation Specialist, Scale AI (Remote). Core strengths include Scale AI, Appen, and Lionbridge. Education includes Bachelor of Science, City College of New York (CCNY), CUNY (2020) and Associate of Applied Science, Borough of Manhattan Community College (BMCC), CUNY (2018). AI-training focus includes data types such as Text and Audio and labeling workflows including RLHF, Transcription, and Evaluation.

Labeling Experience

Lead AI Evaluator & Data Annotation Specialist, Scale AI (Remote)

Scale AITextRLHF

Provided evaluation, ranking, and rating of AI-generated responses for safety, accuracy, tone, and helpfulness as part of RLHF workflows. Reviewed and annotated model outputs with precise adherence to complex guidelines, flagging subtle errors and edge cases. Produced structured written feedback to improve downstream training quality and consistency across high-volume tasks. • RLHF ranking and safety/helpfulness evaluation • Prompt-response evaluation with structured critique • Ground-truth validation and dispute resolution • Guideline refinement to reduce inter-annotator disagreement

2025 - Present

AI Training Data Specialist, Appen (Remote)

AppenAudioTranscription

Evaluated AI-generated search and social media outputs against relevance, quality, and policy requirements, using detailed rating guidelines. Transcribed and quality-reviewed 300+ hours of natural English-language audio with verbatim, accurately labeled transcripts to support speech recognition training. Completed computer vision labeling including segmentation, bounding boxes, and polygons for retail and medical imaging datasets. • Text evaluation for search/social relevance and policy compliance • Audio recording and verbatim transcription for ASR training • Image segmentation, bounding box, and polygon annotations • Quality assurance scoring and contributor performance tracking

2022 - 2024

Freelance Content Reviewer & Search Quality Rater, Lionbridge AI / Telus International (Remote)

LionbridgeText

Rated AI-generated search results and content using guidelines focused on query relevance, page quality, and alignment to user intent. Flagged harmful, misleading, and policy-violating content to support machine learning content moderation training. Ranked among top raters for sustained performance over multiple consecutive months. • Search result relevance and content quality rating • User-intent alignment evaluation • Harmful content identification for moderation pipelines • Consistent guideline-based ratings across thousands of items

2020 - 2022

Education

Work History