Ryan G.

Key Skills

Software

Mercor

Top Subject Matter

LLM response quality evaluation and rubric-based rating

Education

Business Analyst

Top Data Types

Text

Top Task Types

Evaluation/Rating

Prompt + Response Writing (SFT)

Question Answering

Classification

RLHF

Data Collection

Freelancer Overview

AI Model Evaluation Specialist (Independent Contractor) - Mercor. Brings 15+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Mercor. Education includes Bachelor of Education, Master of Teaching, University of Calgary (2011) and Bachelor of Science, University of Calgary (2008). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Model Evaluation Specialist (Independent Contractor) - Mercor

MercorText

Evaluated large language model outputs using structured scoring rubrics and provided written rationales to support model quality improvements. Rated responses across accuracy, reasoning quality, instruction-following, clarity, relevance, and overall usefulness. Performed peer review to verify consistency and alignment with project guidelines for ongoing quality control in AI response assessment workflows. • Applied detailed evaluation criteria to compare and rank multiple model responses • Produced clear written justifications for scores and improvement suggestions • Reviewed peer evaluations for accuracy, consistency, and guideline compliance • Supported quality assurance across AI evaluation and assessment workflows

2025 - Present

Education

Work History