Eric K.

Key Skills

Software

Scale AI

Top Subject Matter

Large language models (LLM) evaluation

rubric-based grading

and RLHF training data annotation

Top Data Types

Text

Document

Image

Top Task Types

RLHF

Bounding Box

Segmentation

Classification

Text Generation

Question Answering

Text Summarization

Object Detection

Prompt + Response Writing (SFT)

Freelancer Overview

AI Model Training & Data Annotation Specialist (Outlier / Scale AI) — Data Annotator / Domain Expert (LLM RLHF). Brings 21+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI. Education includes Bachelor of Science, Emory University (1999). AI-training focus includes data types such as Text and labeling workflows including RLHF.

Labeling Experience

AI Model Training & Data Annotation Specialist (Outlier / Scale AI) — Data Annotator / Domain Expert (LLM RLHF)

Scale AITextRLHF

Contributed to large language model training as a domain expert and data annotator using structured human feedback aligned to task specifications. Evaluated, rated, and ranked model responses for accuracy, coherence, instruction-following, and safety to support RLHF-style fine-tuning and alignment. Performed rubric-based quality scoring and factuality verification to improve downstream model behavior and training data reliability.• Evaluated and graded prompt-and-response pairs using detailed rubrics and safety criteria.• Produced gold-standard/reference answers and refined rationales for consistency and correctness.• Identified hallucinations, edge cases, and model errors with correction notes and documented justifications.• Reviewed peer contributions to ensure adherence to annotation guidelines and SLAs.

2024 - Present

Education

Work History