Brenda W.

Key Skills

Software

Scale AI

Telus

OneForma

Other

Top Subject Matter

Audio and computer vision dataset annotation for AI training and evaluation

Search relevance

Policy/safety Domain Expertise

Top Data Types

Text

Image

Document

Top Task Types

Classification

RLHF

Function Calling

Freelancer Overview

Data Annotator | Scale AI (Remote). Brings 2+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Telus, and OneForma. Education includes Bachelor's Degree, Maseno University. AI-training focus includes data types such as Text, Computer Code, and Programming and labeling workflows including Classification, Evaluation, and Rating.

Labeling Experience

Freelance Software Tester | uTest (by Applause) (Remote)

OtherFunction Calling

Conducted AI, functional, and UX testing for digital products, with emphasis on evaluating AI tool interactions such as chatbots and voice assistants. Provided structured feedback on chatbot and voice assistant accuracy and reliability to support continuous improvement. Reported edge-case failures, broken functionality, and usability issues while following testing guidelines and quality rubrics. • AI interaction testing for chatbot and voice assistant behavior • Structured feedback to improve AI accuracy and reliability • Edge-case identification and issue reporting • Functional and UX testing across web and mobile platforms

2025 - Present

Gen AI Model Trainer & AI Evaluation Specialist | OneForma (Remote)

OneFormaTextRLHF

Evaluated and ranked LLM responses across helpfulness, factuality, safety, instruction-following, reasoning quality, and tone dimensions. Performed preference ranking and comparative response analysis to support reinforcement learning from human feedback (RLHF) workflows. Applied multi-dimensional evaluation rubrics to identify hallucinations, logical inconsistencies, edge-case failures, and bias risks while providing detailed evaluator feedback. • Prompt and response evaluation with structured rubrics • Preference ranking and comparative analysis for RLHF support • Safety and quality review of reasoning-sensitive outputs • Feedback used to guide future model training and alignment priorities

2024 - 2025

Search Specialist & AI Evaluator | TELUS International AI / UHRS / Toloka (Remote)

TelusText

Performed search relevance evaluations by assessing query–result matching, intent satisfaction, landing page quality, and ranking assessment. Evaluated online and social media content for misinformation indicators, policy compliance, toxicity, and sentiment classification. Maintained high agreement with benchmark labels using disciplined guideline adherence and calibration practices. • Search relevance evaluation (ranking and intent satisfaction) • Misinformation, policy compliance, toxicity, and sentiment labeling • A/B testing and ranking experiments for search and recommendations • Calibration and documentation of annotation decisions to improve consistency

2023 - 2024

Data Annotator | Scale AI (Remote)

Scale AITextClassification

Labeled and reviewed audio-related datasets used for speech and intent understanding tasks, including ASR transcription, speaker diarization tagging, and intent classification. Conducted validation checks to find duplicates, taxonomy inconsistencies, and mislabeled entries while maintaining strict quality KPIs. Documented annotation edge cases to improve guideline clarity for future evaluator teams. • ASR transcription and speaker diarization tagging for audio content • Intent classification with calibration on gold-standard tasks • Computer vision labeling (segmentation, polygons, keypoints, bounding boxes) on complex datasets • Dataset validation to reduce downstream QA rejections

2020 - 2020

Education

Work History