Jacob R.

Key Skills

Software

Appen

Other

Top Subject Matter

LLM evaluation and response quality assessment

Speech evaluation

transcription QC

Top Data Types

Text

Audio

Document

Top Task Types

Transcription

Segmentation

Evaluation/Rating

Prompt + Response Writing (SFT)

Text Summarization

Question Answering

Text Generation

Freelancer Overview

AI Data Annotation & LLM Evaluation Specialist (Self-Employed / Contract). Brings 3+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Appen and Other. Education includes Bachelor of Arts (Honours), dBs Institute of Music (2023). AI-training focus includes data types such as Text and Audio and labeling workflows including Evaluation, Rating, and Transcription.

Labeling Experience

AI Audio Evaluator / QC Reviewer – Anuttacon

OtherAudioTranscription

Evaluated speech audio for usability, clarity, and delivery quality across multiple AI projects. Completed quality control review of transcription and tagging outputs to verify guideline adherence. Applied evolving rubrics while maintaining consistency as requirements changed. • Identified hesitation, filler speech, transcription inaccuracies, and metadata tagging issues • Reviewed and validated contributor outputs to support dataset quality • Calibrated judgments against updated evaluation guidelines • Ensured reviewer consistency for downstream training use

2026 - Present

AI Data Annotation & LLM Evaluation Specialist (Self-Employed / Contract)

AppenText

Evaluated and ranked AI-generated responses on reasoning, factuality, instruction-following, and conversational quality. Applied evolving rubrics and evaluation frameworks across multiple LLM-related projects to ensure consistent scoring. Conducted adversarial testing to surface hallucinations, unsafe content, and edge-case behaviors. • Reviewed for coherence, tone, contextual relevance, and instruction alignment • Performed comparative response analysis to support RLHF-style workflows • Identified and documented failure modes for model improvement • Maintained consistency across remote, large-scale evaluation tasks

2026 - Present

Education

Work History