Grayson T.

Key Skills

Software

Scale AI

Other

Appen

Top Subject Matter

Large Language Models

Creative & Persuasive Content

General Knowledge

Top Data Types

Text

Audio

Top Task Types

Prompt + Response Writing (SFT)

Classification

Freelancer Overview

Senior AI Content Evaluator. Brings 9+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Other, and Appen. Education includes Bachelor of Arts, University of Minnesota-Duluth (2014). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Prompt + Response Writing (SFT).

Labeling Experience

Senior AI Content Evaluator

Scale AIText

As a Senior AI Content Evaluator at Scale AI, I evaluated and ranked LLM-generated text for tone, clarity, fluency, factual accuracy, and suitability for various audiences. My work included writing detailed preference feedback and justifications integral to fine-tuning models via RLHF pipelines. I designed and crafted prompts for creative, conversational, persuasive, and knowledge-based scenarios for large-scale AI training. • Evaluated subtle language issues in LLM outputs for clarity and appropriateness. • Consistently achieved inter-annotator agreement scores above 97%. • Collaborated with QA leads to refine annotation guidelines and editorial style guides. • Applied rigorous standards to maintain team quality benchmarks and feedback processes.

2022 - Present

AI Content Trainer

OtherTextPrompt + Response Writing (SFT)

As an AI Content Trainer at Invisible Technologies, I trained generative AI models by producing high-quality, audience-aware prompt-response pairs across a wide array of language tasks. My responsibilities included reviewing and scoring model-generated text for voice, coherence, and factual grounding, with critical attention to user intent. I provided structured feedback and editorial judgment to enhance content quality across projects. • Wrote and reviewed prompt-response pairs in creative and everyday scenarios. • Assessed outputs for misleading, biased, or inappropriate language before deployment. • Authored detailed reports to guide content quality improvements and project strategies. • Maintained a throughput of over 40 quality-reviewed tasks per day with top-tier accuracy ratings.

2020 - 2022

Content & Data Annotation Specialist

AppenTextClassification

At Appen, as a Content & Data Annotation Specialist, I labeled and reviewed written, audio, and multimedia content to support AI model training for language understanding and content moderation. I followed detailed guidelines to assess search result relevance, web page quality, and the appropriateness of written responses in diverse contexts. My work included mentoring and supporting the onboarding of new annotators to improve team efficiency. • Labeled content spanning text, audio, and multimedia for language and moderation tasks. • Applied detailed rubrics for intent, nuance, and cultural sensitivity in AI-generated outputs. • Mentored new annotators for improved team performance and reduced onboarding time. • Coordinated with project managers to refine protocols and annotation consistency.

2018 - 2019

Education

Work History