Jimmy J.

Key Skills

Software

Other

Appen

Top Subject Matter

LLM annotation

RLHF preference ranking

annotation QA/IAA

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Segmentation

Classification

Freelancer Overview

Senior Data Annotation Lead at Apex Intelligence Inc.. Brings 7+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Other and Appen. Education includes Master of Science, University of Florida (2023) and Bachelor of Science, University of Florida (2017). AI-training focus includes data types such as Text and Image and labeling workflows including RLHF, Segmentation, and Classification.

Labeling Experience

Senior Data Annotation Lead at Apex Intelligence Inc.

OtherTextRLHF

Led RLHF preference ranking annotation workflows to support large language model fine-tuning serving millions of users. Implemented active learning loops to prioritize high-uncertainty samples and optimize the annotation queue per training cycle. Established inter-annotator agreement measurement using Cohen's Kappa to improve label consistency and reduce rework. • Coordinated annotation teams (22 annotators, 3 QA analysts) across multiple LLM and CV initiatives • Improved helpfulness and safety benchmarks through RLHF-driven data work • Reduced turnaround time and rework via IAA scoring system • Refined labeling schemas for low-performing edge classes to boost precision

2022 - Present

Data Labeling Specialist II at DataVision Corp.

OtherImageSegmentation

Produced 1.8M+ annotated images for autonomous vehicle perception spanning pedestrians, cyclists, traffic signs, and road markings across multiple environments. Authored SOPs for new labeling task types to accelerate onboarding and standardize annotation quality. Led bias audit work on a facial recognition dataset by identifying demographic imbalances that informed revised data collection strategy. • Delivered production-ready computer vision annotations for AV systems • Wrote 40+ SOPs supporting a 30-person contractor pool • Supervised audio annotation and speaker diarization for ASR model training • Conducted dataset bias auditing and QA for demographic balance

2019 - 2021

AI Data Annotator at Lionbridge AI (Appen contract)

AppenTextClassification

Performed large-scale annotation across NLP classification, sentiment labeling, image segmentation, and search relevance rating for Fortune 500 AI clients. Maintained top-tier quality ratings for consecutive months within global project pools. Supported team quality by mentoring junior annotators on best practices and escalation procedures. • Labeled NLP classification, sentiment, and search relevance data • Contributed to image segmentation annotation tasks • Sustained 4.95/5 quality rating for 18 months • Mentored 8 junior annotators on edge-case handling

2016 - 2019

Education

Work History