Joel K.

Key Skills

Software

Scale AI

Don't disclose

Other

Top Subject Matter

LLM evaluation

RLHF feedback

prompt engineering

Top Data Types

Text

Document

Image

Top Task Types

Data Collection

Classification

Freelancer Overview

AI Trainer & LLM Evaluator at Outlier (Scale AI). Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Don't disclose, and Other. Education includes Bachelor of Science, University of Nairobi (2023). AI-training focus includes data types such as Text and Document and labeling workflows including Evaluation, Rating, and Data Collection.

Labeling Experience

AI Trainer & LLM Evaluator at Outlier (Scale AI)

Scale AIText

Provided LLM response evaluation by ranking outputs for accuracy, tone, coherence, logical consistency, and guideline adherence. Produced prompt variants to expose weaknesses in reasoning, factuality, and instruction-following for training data improvement. Participated in RLHF by writing nuanced preference comparisons and supporting red-teaming for unsafe, biased, or policy-violating responses. • LLM response ranking and written rationales for model teams • Quality scoring against task guidelines across 500+ tasks • RLHF preference comparisons to shape reward signals • Red-teaming to improve content safety benchmarks

2024 - Present

AI Data Contributor & Career Platform Specialist at Handshake

Don't discloseDocumentData Collection

Annotated and labeled professional profile and job-candidate fit data to improve natural language understanding for career discovery features. Evaluated AI-generated career guidance content for quality, relevance, and user appropriateness, flagging inaccuracies and proposing improvements. Assisted resume parsing validation, entity recognition, and skills taxonomy classification across a large set of professional profiles. • Structured feedback on job-candidate fit assessments • Content evaluation for career guidance relevance and correctness • Resume parsing validation and entity recognition support • Skills taxonomy classification with guideline-driven consistency

2023 - 2024

Freelance Content Reviewer & Data Annotator (Independent Contractor)

OtherTextClassification

Performed annotation and review tasks spanning image labeling, text classification, sentiment analysis, and audio transcription QA across multiple AI platforms. Applied detailed attention to detail to maintain high inter-rater agreement and exceed platform accuracy thresholds. Followed task guidelines and quality rubrics to support AI training dataset creation and validation. • Image labeling and text classification review • Sentiment analysis annotation under quality thresholds • Audio transcription QA and correctness checks • Adherence to labeling rubrics and inter-rater agreement targets

2023 - 2023

Education

Work History