Michael J.

Key Skills

Software

Other

Label Studio

Top Subject Matter

LLM training and AI response evaluation (RLHF, red teaming)

Multimodal annotation (text, image, audio) and document/OCR validation

Quality assurance for data annotation projects

Top Data Types

Text

Image

Document

Top Task Types

Segmentation

Freelancer Overview

Senior AI Trainer (AI output evaluation and RLHF ranking). Brings 16+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Other and Label Studio. Education includes Master of Science, University of Michigan (2010) and Bachelor of Science, Michigan State University (2008). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Segmentation.

Labeling Experience

Senior AI Trainer (AI output evaluation and RLHF ranking)

OtherText

Evaluated AI-generated outputs for factual accuracy, logical reasoning, safety, and instruction adherence to ensure high-quality deliverables. Performed RLHF preference and ranking assessments using pairwise and rubric-based methods to support model improvement. • Factual accuracy and reasoning checks • Safety and policy adherence evaluation • Instruction-following quality assessment • Output ranking via pairwise/rubric RLHF

2021 - Present

AI Data Labeling Specialist (annotation and validation)

Label StudioTextSegmentation

Annotated multimodal datasets with a focus on semantic segmentation and object detection workflows. Completed additional NER annotation and document/ OCR validation to improve downstream model training data quality. • Semantic segmentation and object detection labeling • Named entity recognition (NER) annotation • OCR output and document dataset validation • Maintained annotation accuracy exceeding 99%

2017 - 2021

Quality Assurance Reviewer (annotation QA and reviewer training)

OtherText

Reviewed and validated labeled data to improve consistency through inter-annotator agreement analysis. Created QA documentation and labeling guidelines, and supported onboarding by training new annotators and reviewers. • Inter-annotator agreement analysis • QA documentation and guideline development • Annotator onboarding and training • Ensured compliance with quality standards and protocols

2014 - 2017

Education

Work History