For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
A

Andrew J.

AI Product Architect / AI Evaluation Specialist

Key Skills

Software

Scale AIScale AI
AppenAppen
RemotasksRemotasks

Top Subject Matter

Generative AI/LLMs
NLP and Computer Vision
Content Moderation/Image Classification

Top Data Types

TextText
ImageImage
DocumentDocument

Top Task Types

ClassificationClassification

Freelancer Overview

AI Product Architect / AI Evaluation Specialist. Core strengths include Scale AI, Appen, and Remotasks. Education includes Bachelor of Science, Stanford University (2024). AI-training focus includes data types such as Text and Image and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

Appen

AI Data Annotator & Quality Reviewer (Freelance)

AppenAppenTextTextClassificationClassification

In this freelance role, I annotated and reviewed datasets for machine learning model training, spanning both NLP and computer vision tasks. My responsibilities included QA checks, error identification, and thorough adherence to annotation guidelines. I maintained high accuracy and consistency in remote, high-volume annotation projects. • Annotated and classified structured data across multiple domains • Performed detailed QA reviews on labeled datasets • Delivered feedback reports to enhance annotation quality • Operated independently in fully remote settings with deadline-driven demands.

2023 - Present
Scale AI

AI Product Architect / AI Evaluation Specialist

Scale AIScale AITextText

As an AI Evaluation Specialist, I assessed AI-generated responses using structured evaluation rubrics and benchmarks. My work focused on identifying hallucinations, reasoning errors, and guideline violations in LLM and generative AI outputs. I provided detailed, structured rationales for all judgments and evaluation decisions. • Evaluated and rated AI system outputs for accuracy, quality, and compliance • Designed and applied sophisticated evaluation rubrics • Collaborated with technical teams to improve model alignment and QA outcomes • Supported data validation and prompt testing for AI performance improvement.

2024 - 2025
Remotasks

Content Moderator & Data Quality Reviewer

RemotasksRemotasksImageImageClassificationClassification

As a Content Moderator and Data Quality Reviewer, I evaluated platform-generated and user-contributed image content using structured moderation and classification guidelines. My tasks included identifying inappropriate material, mislabels, and ambiguity in large content datasets. I ensured consistent application of policies across all reviewed items. • Reviewed and classified user-generated and platform content images • Flagged errors and escalated ambiguous cases as needed • Maintained high-speed accuracy in moderation workflows • Applied platform and legal policy rules to guide decisions.

2022 - 2022

Education

S

Stanford University

Bachelor of Science, Computer Science

Bachelor of Science
2020 - 2024