Jamie A.

Key Skills

Software

Data Annotation Tech

Top Subject Matter

Stem Domain Expertise

Health Domain Expertise

general knowledge

Top Data Types

Text

Document

Top Task Types

Evaluation/Rating

Prompt + Response Writing (SFT)

Question Answering

Text Generation

RLHF

Freelancer Overview

Experienced AI evaluator with hands-on data annotation and labelling work through DataAnnotation, where I evaluate and rank large language model responses against detailed quality rubrics covering accuracy, reasoning, safety and tone. My work involves writing structured critiques of model outputs, refining prompts to probe behaviour across STEM, health and general knowledge domains, and maintaining consistent quality across high volumes of tasks with tight feedback loops — all directly applicable to data annotation projects requiring precision and adherence to guidelines. I bring strong scientific reasoning through a BSc (Hons) Health Sciences degree (on track for a First at the Open University), with a foundation in biology, chemistry, psychology and statistics. This, combined with six years of operational leadership at Tesco — managing teams, reporting against KPIs, and making evidence-based decisions under pressure — means I'm comfortable working independently to deadlines, following detailed instructions, and delivering reliable, high-quality results. I also have growing technical skills in Python, SQL, Power BI and Excel, which support data-focused work.

Labeling Experience

AI Evaluator (Freelance)

Data Annotation TechText

As a freelance AI Evaluator at DataAnnotation, I assessed outputs from large language models (LLMs) using structured quality rubrics. I wrote and refined prompts to probe and analyze model behavior, providing detailed written critiques to support model alignment. My work ensured consistent, high-quality task output under strict guidelines and tight feedback loops. • Evaluated model responses for accuracy, reasoning, instruction following, safety, and tone. • Developed prompts targeting STEM, health, general knowledge, and writing domains. • Delivered structured feedback to aid LLM training and downstream improvements. • Maintained high task volume and adherence to detailed guidelines.

2024 - Present

Education

Work History