Ryan M.

Key Skills

Software

Other

Top Subject Matter

Financial Planning & Wealth Management

Data Analysis & Analytical Reasoning

Artificial Intelligence & LLM Evaluation

Top Data Types

Text

Image

Audio

Top Task Types

RLHF

Prompt + Response Writing (SFT)

Evaluation/Rating

Freelancer Overview

I have experience evaluating, analyzing, and refining AI-generated outputs across reasoning, summarization, instruction-following, and comparative evaluation tasks. My work includes building structured evaluation rubrics, ranking model responses, identifying hallucinations and factual inconsistencies, assessing reasoning quality, and improving prompt design for LLM training workflows. I have also developed detailed evaluation frameworks for response calibration, preference ranking, and quality scoring, with a strong focus on clarity, accuracy, nuance, and consistency. Through my work as a Generalist Evaluator Expert with Mercor, I have gained hands-on experience reviewing complex outputs and applying structured judgment in high-accuracy evaluation environments. My broader professional background in finance, consulting, and operations further strengthens my ability to contribute to AI training projects requiring analytical reasoning, domain expertise, and precision. As a Financial Advisor, I routinely synthesize large volumes of technical and financial information, communicate complex concepts clearly, and operate within highly regulated, detail-sensitive environments. This combination of quantitative analysis, communication skills, compliance-oriented thinking, and AI evaluation experience allows me to perform well on tasks involving annotation quality review, response evaluation, reasoning assessment, summarization, and data quality assurance.

Education

Work History