Michael N.

Key Skills

Software

Mercor

Appen

Other

Top Subject Matter

Generative AI evaluation

RLHF workflows

AI safety testing

Top Data Types

Text

Audio

Video

Document

Top Task Types

Entity (NER) Classification

Tracking

RLHF

Red Teaming

Data Collection

Freelancer Overview

AI Model Training Specialist (Contract) | Mercor AI | Remote. Brings 9+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Mercor, Appen, and Other. Education includes Master of Science, Georgia Institute of Technology (2021) and Bachelor of Science, Georgia State University (2017). AI-training focus includes data types such as Text, Audio, and Computer Code and labeling workflows including Evaluation, Rating, and Entity (NER) Classification.

Labeling Experience

AI Model Training Specialist (Contract) - Mercor AI

AppenVideoRLHFRed Teaming

Evaluated and ranked LLM outputs for reasoning quality, factual accuracy, coherence, and domain alignment across technical and research-focused tasks. Drove RLHF workflows by producing structured evaluation feedback and identifying complex edge-case failure modes. Performed QA on structured and multimodal datasets while maintaining strict guideline compliance and improving response quality through systematic prompt optimization and adversarial testing. • LLM output evaluation across safety, accuracy, and reasoning dimensions • RLHF workflow support with structured feedback generation • Prompt optimization, adversarial red-teaming, and hallucination detection • Multimodal (text, audio, video) dataset annotation QA and benchmarking

2024 - Present

AI Model Training Specialist (Contract) | Mercor AI | Remote

MercorText

Evaluated and ranked LLM outputs using structured rubrics for reasoning quality, factual accuracy, coherence, and domain alignment. Produced RLHF-style feedback by identifying edge-case failure modes and recommending improvements. Maintained guideline compliance while supporting multimodal dataset QA where required.• LLM response ranking and quality evaluation across multiple criteria• Hallucination detection and adversarial testing to improve response quality• Structured RLHF feedback loop contributions for model alignment• Contributed to LLM benchmarking and scoring workflows for multiple architectures

2024 - Present

Data Annotation & AI Specialist (Contract) | Appen | Remote

AppenAudioEntity (NER) ClassificationTracking

Annotated and validated NLP, audio, and video datasets for AI training systems while consistently achieving high-quality tier ratings. Conducted QA audits to find edge cases and improve data quality for better model generalization. Refined annotation guidelines for ambiguous or context-sensitive tasks to increase team consistency.• Annotated NLP, audio, and video data for training pipelines• Performed QA auditing and edge-case identification• Evaluated AI outputs for contextual accuracy and rubric compliance• Updated/refined annotation guidelines for consistency across tasks

2020 - 2021

Research Assistant – Computational Data & Biological Systems | Georgia State University

OtherData Collection

Supported research data preparation by building scripts to clean, transform, visualize, and analyze biological datasets. Applied ML and statistical techniques to environmental and biological datasets in support of published research workflows. Contributed to reproducible analytical workflow development and research documentation.• Data cleaning and transformation scripting using Python• Visualization and statistical analysis of biological datasets• Application of ML/statistical methods in research contexts• Assisted with reproducible reporting and documentation

2018 - 2020

Education

Work History