A G.

Key Skills

Software

No software listed

Top Subject Matter

LLM evaluation

rubric development

comparative assessment

Top Data Types

Text

Audio

Top Task Types

Evaluation/Rating

Prompt + Response Writing (SFT)

Transcription

Text Summarization

Red Teaming

Question Answering

Freelancer Overview

AI Evaluation Specialist, Independent Contractor. Professional background includes roles such as AI Evaluation Specialist (Independent Contractor) and Senior Gamesmaker. Core strengths include Internal and Proprietary Tooling. Education includes Master of Arts, Royal Central School of Speech and Drama and Doctor of Philosophy, Royal Central School of Speech and Drama. AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Evaluation Specialist, Independent Contractor

Text

Performed LLM output evaluations across reasoning quality, factuality, instruction-following, safety, and conversational quality using rubrics and preference-based frameworks. Conducted comparative assessments of AI responses, including red-team-style tests to uncover weaknesses in reasoning and adherence. Developed and refined evaluation rubrics and quality frameworks to standardize model testing and multi-turn judgment. • Evaluated multi-turn conversations and structured outputs for domain-specific reasoning challenges • Designed complex synthetic scenarios requiring nuanced policy interpretation and quality discrimination • Applied safeguarding protocols within red-team testing intended for vulnerable populations • Assessed other evaluators’ processes and outputs across LLM test categories

2022 - Present

Education

Work History