Kelly W.

Key Skills

Software

Remotasks

Other

Top Subject Matter

NLP and computer vision datasets

AI safety and robustness

LLM response evaluation

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Freelancer Overview

Core strengths include Remotasks and Other. Education includes Bachelor of Medical/Biomedical Sciences, Moi University (2023). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and RLHF.

Labeling Experience

Freelance AI Trainer | Various AI Platforms (Remote) | 2023–Present

OtherTextRLHF

Annotated and evaluated AI-generated responses across scientific, medical, and general knowledge domains to improve model accuracy and safety. Crafted and refined LLM prompts while assessing relevance, coherence, factual accuracy, and tone of outputs. Produced detailed preference rankings and written rationales for RLHF pipelines, and documented edge cases, biases, and hallucinations. • Perform response annotation and evaluation across multiple knowledge domains • Create and refine prompts for LLM quality assessment • Provide preference rankings with written rationale for RLHF • Identify and report edge cases, biases, and hallucinations for research teams

2023 - Present

AI Data Annotator (Contract) | Remotasks / Scale AI | 2022–2023

RemotasksText

Labeled and categorized training datasets for NLP and computer vision model improvement. Reviewed and corrected AI-generated text for grammar, factuality, and contextual appropriateness to ensure high-quality training signals. Participated in red-teaming activities to assess model robustness and safety guardrails. • Labeled and categorized examples for dataset curation • Performed text review and correction for quality and relevance • Joined red-teaming exercises for safety and robustness evaluation • Achieved high inter-annotator agreement scores as a top-tier performer

2022 - 2023

Education

Work History