Joshley

Key Skills

Software

Mercor

Top Subject Matter

Large language model (LLM) quality assurance and RLHF data validation

Software Engineering – Code Evaluation & Debugging Logic

Personal Finance & Investment Analysis

Top Data Types

Text

Image

Video

Top Task Types

RLHF

Evaluation/Rating

Prompt + Response Writing (SFT)

Classification

Freelancer Overview

Senior Domain Expert | Mercor (LLM output evaluation and RLHF-related auditing). Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Mercor. Education includes Bachelor of Science, University of Wisconsin-Madison. AI-training focus includes data types such as Text and labeling workflows including RLHF.

Labeling Experience

Senior Domain Expert | Mercor (LLM output evaluation and RLHF-related auditing)

MercorTextRLHF

Evaluated and optimized frontier LLM outputs by engineering prompts, identifying edge cases, and auditing responses for strict factual accuracy, logic, and formatting. Produced structured analytical justifications to rank model performance and inform RLHF training pipeline decisions. Performed multi-domain workflow audits to maintain data integrity and quality-assurance metrics. • Engineered complex prompts for improved LLM output quality • Audited responses against factual, logical, and formatting constraints • Authored ranking rationales used to guide RLHF training • Maintained data integrity across multi-domain generalist workflows

2026 - 2026

Education

Work History