George B.

Key Skills

Software

Scale AI

Other

Data Annotation Tech

Lionbridge

Top Subject Matter

LLM alignment

preference ranking

and model evaluation

Top Data Types

Text

Image

Top Task Types

RLHF

Prompt + Response Writing (SFT)

Fine-tuning

Entity (NER) Classification

Data Collection

Freelancer Overview

Senior AI Trainer & Evaluator — Outlier AI (via Scale AI). Brings 2+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Other, and Data Annotation Tech. Education includes Bachelor of Science, State University (2020). AI-training focus includes data types such as Text, Computer Code, and Programming and labeling workflows including RLHF, Prompt + Response Writing (SFT), and Fine-tuning.

Labeling Experience

Senior AI Trainer & Evaluator — Outlier AI (via Scale AI)

OtherTextPrompt + Response Writing (SFT)

Authored 1,200+ prompt–response pairs for supervised fine-tuning across coding, math, and reasoning domains. Produced training examples rated within the top 10% of contributors based on rubric-defined quality criteria. Ensured that responses met domain correctness and reasoning expectations for model learning. • Wrote structured prompt–response data for SFT • Curated coding, mathematics, and reasoning content • Applied quality guidelines to maximize rubric scores • Iterated on examples based on contributor feedback

2023 - Present

Senior AI Trainer & Evaluator — Outlier AI (via Scale AI)

Scale AITextRLHF

Completed 800+ RLHF preference-ranking tasks for large language models using gold-standard references. Achieved a 96% inter-rater agreement score and contributed to preference quality calibration. Supported downstream evaluation and safety processes through consistent labeling rigor. • Performed preference ranking and comparative judgments • Verified consistency against gold-standard labels • Tracked and improved inter-rater agreement performance • Collaborated on iterative rubric improvements with evaluators

2023 - Present

AI Data Annotator — DataAnnotation.tech

Data Annotation Tech

Specialized in code generation review by evaluating Python, JavaScript, and SQL outputs. Assessed correctness, efficiency, and adherence to best practices when selecting higher-quality responses. Ensured labeled outputs were usable and aligned with expected programming standards. • Reviewed code for correctness and logical validity • Checked efficiency and performance considerations • Verified best-practice adherence • Supported preference decisions based on code quality

2021 - 2022

AI Data Annotator — DataAnnotation.tech

Data Annotation TechTextFine-tuning

Produced DPO (Direct Preference Optimization) training pairs by carefully ranking model outputs. Labeled helpfulness, factual accuracy, and safety across 500+ tasks to create preference data. Ensured that selected outputs aligned with desired model behavior for fine-tuning. • Ranked outputs for DPO preference pair creation • Assessed helpfulness and factual accuracy • Evaluated safety and policy adherence • Delivered 500+ labeled preference cases

2021 - 2022

Content Quality Analyst — Lionbridge AI

OtherTextData Collection

Performed structured data labeling for image, text, and document annotation tasks at scale. Met strict daily throughput and accuracy KPIs while maintaining consistent annotation quality. Coordinated labeling activities to ensure reliable dataset contributions for downstream use. • Labeled multi-modal data including text and documents • Followed structured annotation guidelines • Met daily throughput and accuracy targets • Collaborated with project stakeholders to maintain quality

2020 - 2021

Show more

Education

Work History