Jayson C.

Key Skills

Software

Labelbox

Mercor

Top Subject Matter

Aviation Communications

Financial Compliance & Risk Analysis

Investment Banking

Top Data Types

Audio

Text

Image

Document

Top Task Types

Transcription

RLHF

Red Teaming

Evaluation/Rating

Prompt + Response Writing (SFT)

Bounding Box

Object Detection

Question Answering

Freelancer Overview

Experienced data annotator and AI labeling specialist with hands-on production work across all four major annotation modalities: text/NLP, image/visual content, audio transcription, and RLHF preference ranking. Rated 4.4/5.0 (High Tier) across 342 verified reviews spanning 7 projects — a third-party performance record demonstrating sustained precision, consistency, and output quality at scale. Promoted to QA Reviewer on an aviation communications transcription project based on sustained 95%+ accuracy across high-volume tasks. What sets me apart is deep domain expertise in specialized subject matter — investment banking, quantitative finance, global markets, aviation communications, and Formula 1 technical regulations — combined with experience on the quality and rubric side of the work. I build the golden response benchmarks and scoring frameworks used to calibrate other annotators, author annotation guidelines targeting 70%+ inter-rater agreement, and contribute structured RLHF feedback used directly in model training pipelines. That combination of frontline labeling precision and quality system design is what I bring to every project.

Labeling Experience

AI Evaluator & Prompt Engineer

Text

Worked as an AI Evaluator and Prompt Engineer on Project Pontius at Alignerr, annotating and evaluating AI-generated finance-domain text. Evaluated outputs for factual accuracy, reasoning quality, numerical soundness, tone, and adherence to quantitative finance and investment banking protocols. Produced RLHF preference rankings and designed evaluation rubrics used to calibrate other annotators and set benchmarks. • Developed golden set response benchmarks for ground truth scoring. • Wrote detailed qualitative rationales for RLHF-based model training. • Covered subject matter spanning investment banking and quantitative finance. • Ensured annotation accuracy across complex financial scenarios.

2026 - Present

Investment Banking AI Research Evaluator

Text

Served as Investment Banking AI Research Evaluator for Project Sapphire at Handshake AI. Annotated and evaluated AI-generated investment banking research outputs, including M&A, Leveraged Finance, ECM, and DCM content, for technical accuracy, instruction following, and risk compliance. Authored annotation guidelines and produced golden response benchmarks for downstream annotation and scoring projects. • Delivered outputs to VP/MD standards using Excel, PowerPoint, and Word. • Targeted high inter-rater agreement performance metrics (≥70%). • Developed guidelines based on the ATSO framework for reproducibility. • Evaluated outputs for client readiness and internal consistency.

2025 - Present

QA Reviewer & Annotation Specialist

AudioTranscription

Served as QA Reviewer and Annotation Specialist for high-volume aviation communications transcription on Project Aura at Alignerr. Responsible for reviewing contributor outputs, identifying error patterns, and providing structured feedback for calibration and guideline refinement. Maintained high-precision annotation standards against strict FAA guidelines while ensuring consistency and reliability at scale. • Promoted based on sustained 95%+ accuracy rates. • Applied structured QA methodologies to error analysis and process improvement. • Provided direct feedback to annotators to enhance output quality. • Contributed to guideline documentation and inter-rater calibration efforts.

2025 - Present

Education

Work History