Samuel O.

Key Skills

Software

Scale AI

Top Subject Matter

1. Artificial Intelligence / Machine Learning

Language & Communication (English Writing / Editing)

Data Annotation / Data Quality

Top Data Types

Text

Image

Document

Top Task Types

Evaluation/Rating

RLHF

Text Summarization

Freelancer Overview

AI/LLM Trainer and AI Response Evaluator with hands-on experience reviewing and evaluating large language model outputs for accuracy, clarity, relevance, and guideline compliance at Scale AI. Experienced in data annotation, response scoring, content evaluation, research, and quality assurance, with a strong background in professional writing and editing. Skilled at identifying inconsistencies, improving response quality, and providing structured feedback to support AI training workflows. Recently completed certifications in Generative AI, Prompt Engineering, and AI Ethics, with a strong interest in AI development, human-in-the-loop systems, and language model improvement.

Labeling Experience

AI/LLM Trainer (AI response evaluator) at Scale AI, Remote

Scale AIText

Reviewed LLM outputs to score and label responses for accuracy, relevance, clarity, and adherence to project guidelines. Built and maintained labeled datasets by tagging and classifying text examples to teach the model correct interpretation and response. Performed consistency checks on annotated data to identify ambiguous labels and common error patterns and to ensure quality standards are met. • Assigned scores/labels to inform downstream model training • Tagged, classified, and organized text examples for dataset curation • Checked annotations for consistency, correctness, and ambiguity • Wrote actionable feedback on edge cases and undesirable outputs to refine rubrics and protocols

2025 - 2025

Education

Work History