Matthew C.

Key Skills

Software

Appen

Data Annotation Tech

Labelbox

Telus

Other

Top Subject Matter

LLM prompt/response annotation and evaluation

Response quality evaluation for LLM outputs

Audio response transcription and dataset annotation

Top Data Types

Image

Text

Video

Audio

Document

Top Task Types

Audio Recording

Bounding Box

Text Generation

Classification

Transcription

Freelancer Overview

Contributed to many different platforms as a top performer. Experience reviewing colleagues work to verify quality standards, with my own work being used as training examples on subsequent tasks. (Data Annotation) Demonstrated track record of providing exceptional quality data to train models that is evident in final and up to date models.

Labeling Experience

Data Annotator at Outlier (2024 – Present)

OtherAudioTranscription

Produced and annotated datasets across multiple projects while maintaining a consistent quality standard during both creation and review. You transcribed audio responses and edited them in alignment with each project’s guidelines. You also reviewed outputs to ensure they met the required quality criteria. • Produced annotated data across multiple projects • Maintained consistent quality during production and review • Transcribed audio responses per guidelines • Edited transcriptions to match project requirements

2024 - Present

Data Annotator at Alignerr (2024 – Present)

LabelboxTextClassification

Created classification criteria to assess response quality using a concrete rubric. You wrote and implemented the rubric in Labelbox to categorize response quality based on defined standards. You transcribed and interpreted audio responses from both user and model perspectives, and rated and reviewed other annotations for consistency with guidelines. • Authored criterion/rubric for response quality classification • Implemented rubric in Labelbox • Transcribed and interpreted audio responses (user/model views) • Rated and reviewed annotations for guideline consistency

2024 - Present

Data Annotator / Prompt Engineer at Dataannotation.tech (2023 – Present)

Data Annotation TechText

Edited and optimized LLM responses to support training and improvement of large language models through human-in-the-loop review. You rated and reviewed other users’ work for consistency and quality against project expectations. You provided feedback to refine annotation guidelines and conducted periodic audits to ensure compliance with standards. • Reviewed and edited LLM prompt/response outputs • Evaluated annotations for consistency and quality • Contributed feedback to improve guidelines/processes • Performed audits for compliance with project standards

2023 - Present

Education

Work History