Barry F.

Key Skills

Software

Appen

Mercor

Clickworker

Data Annotation Tech

Figure Eight

Labelbox

Lionbridge

Micro1

Mindrift

OneForma

SuperAnnotate

Toloka

Telus

Other

Top Subject Matter

AI/ML Model Training and Evaluation

Healthcare Domain Expertise

Content Creation (Creative Writing, Children's, Educational, and more) Expertise

Top Data Types

Text

Audio

Image

Document

Top Task Types

Red Teaming

Data Collection

Bounding Box

Segmentation

Classification

Entity (NER) Classification

Object Detection

Text Generation

Question Answering

Text Summarization

RLHF

Fine-tuning

Transcription

Evaluation/Rating

Freelancer Overview

AI Model Trainer + Web Development SME. Brings 14+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal, Proprietary Tooling, and Appen. Education includes Master of Science, Jacksonville University (2018) and Bachelor of Arts, Miami University (2004). AI-training focus includes data types such as Text and Audio and labeling workflows including Evaluation, Rating, and Red Teaming.

Labeling Experience

AI Model Trainer + Web Development SME

Text

As an AI Model Trainer and Web Development SME at Handshake AI, I performed prompt evaluation, response ranking, entity tagging, and policy-based content moderation for various text-based AI/ML tasks. I reviewed and labeled data to identify hallucinations, bias, and safety risks, supporting improved model reliability. My responsibilities required adapting to evolving labeling guidelines and using a range of internal and proprietary tools. • Conducted time-bound annotation and red teaming projects • Maintained quality and compliance scores of 85–90% • Supported NLP, chatbot safety, and LLM QA pipelines • Worked on multimodal model evaluation and RLHF tasks

2025 - Present

Web Data Analyst

AppenText

During my time as a Web Data Analyst at Appen.com, I reviewed, labeled, and evaluated content for over 150 AI/ML projects. This work included supporting NLP, chatbot safety, and multimodal training and evaluation pipelines. Tasks involved prompt evaluation, entity tagging, and red teaming within high-volume production environments. • Maintained 85–90% annotation accuracy in labeling tasks • Performed content moderation for community guideline compliance • Adapted to frequently updated internal tools and protocols • Collaborated with global annotation teams for consistent output

2019 - 2024

Red Team Model Trainer

RemotasksTextRed Teaming

As a Red Team Model Trainer at Remotasks / Outlier.com, I evaluated and labeled AI model responses to identify content safety issues. My tasks involved testing chatbot interactions for hallucinations, bias, and guideline adherence. I supported RLHF workflows and reported on model vulnerabilities for safer AI deployments. • Used internal or proprietary labeling platforms for task completion • Conducted response classification and bias mitigation analysis • Generated prompt-response pairs for SFT exercises • Documented edge-case findings to improve guideline precision

2022 - 2023

AI Trainer Generalist (Contract)

MercorText

As an AI Trainer Generalist at Mercor, I supported various AI/ML data labeling and evaluation activities. I conducted prompt evaluation, text classification, and RLHF for multiple projects. Tasks included annotating model responses and contributing to quality assurance for labeled data. • Facilitated accurate data annotation to improve AI performance • Maintained project-specific compliance and efficiency metrics • Worked in fast-paced production settings for iterative AI model tuning • Engaged in documentation and process refinement for annotation tasks

2020 - 2021

Project Lead – Speech Data (Contract)

AudioData Collection

Through short-term contracts with Neevo/DefinedCrowd, I led and participated in labeled speech data projects as a Project Lead. Responsibilities included audio data collection, transcription, and classification for language model training. I oversaw quality assurance and contributed to asset taxonomy creation for audio datasets. • Managed project workflow and QA for speech annotation • Classified and transcribed multilingual datasets for NLP • Trained contributors on labeling protocol adherence • Reported progress to clients and worked cross-functionally

2020 - 2021

Show more

Education

Work History