K W.

Key Skills

Software

Other

Top Subject Matter

LLM output evaluation

rubric-based assessment

and training feedback for AI models

Top Data Types

Text

Document

Top Task Types

Entity (NER) Classification

RLHF

Freelancer Overview

Independent AI Training & Evaluation Contributor (Remote). Brings 5+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Other. Education includes Google UX Design Certificate, Coursera and IBM Product Manager Professional Certificate, Coursera. AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Translation.

Labeling Experience

Human Feedback & Annotation Specialist (Contract Work)

OtherTextEntity (NER) Classification

Annotated conversational datasets by labeling user intent and conversational attributes to support training and evaluation. Ranked competing responses, identified hallucinations, flagged safety issues, and produced gold-standard examples for training. Ensured labeled outputs were consistent with rubric expectations and corrected model behavior through structured feedback. • Labeled intents and conversational categories from dialogue data • Ranked multiple model responses and justified preferences • Flagged hallucinations and safety/policy issues in generated outputs • Created and curated gold-standard training examples

2024 - Present

Swahili Language Data Specialist (Remote Projects)

OtherText

Performed Swahili language review and validation tasks to improve multilingual AI response quality. Evaluated naturalness, fluency, and regional usage while refining dataset examples for multilingual systems. Applied linguistic correction and intent-focused classification to support accurate conversational behavior. • Validated translations and corrected linguistic issues in Swahili responses • Conducted intent classification and linguistic correction for dataset refinement • Evaluated multilingual naturalness and response quality • Refined multilingual training inputs for improved model performance

2024 - Present

Independent AI Training & Evaluation Contributor (Remote)

OtherText

Provided evaluation and scoring for frontier AI model outputs across multiple domains, including factual accuracy, instruction following, reasoning quality, tone alignment, and policy compliance. Built and executed structured evaluation workflows and generated thousands of scored AI interactions for training and improvement. Reviewed and compared model responses to support iterative refinement of model behavior. • Assessed response quality using rubric-based criteria for accuracy and helpfulness • Created and validated structured training examples for consistent evaluation • Performed human-in-the-loop style feedback to improve model outputs • Produced evaluation datasets spanning educational, technical, customer-support, and conversational scenarios

2024 - Present

UI/UX Specialist & AI Workflow Reviewer

OtherTextRLHF

Acted as a UI/UX specialist and AI workflow reviewer, applying structured evaluation methods to user-facing AI products. Tested model-generated content, documented failures, and proposed quality improvements to strengthen system behavior. Supported ongoing quality assurance for conversational and search-related AI capabilities through iterative review. • Reviewed AI-assisted user workflows and identified failure modes • Evaluated chatbot conversation quality for accuracy, safety, and helpfulness • Documented issues and suggested improvements based on observed behavior • Supported continuous refinement of AI responses in a human-in-the-loop workflow

2023 - Present

Education

Work History