For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
A
Austen B.

Austen B.

AI Systems Evaluation Analyst - Freelance

USA flagN/A, Usa

Key Skills

Software

Don't disclose
Other

Top Subject Matter

AI agent evaluation and dataset validation
AI data annotation support
logic validation

Top Data Types

TextText
ImageImage

Top Task Types

Object DetectionObject Detection
Question AnsweringQuestion Answering
Data CollectionData Collection

Freelancer Overview

AI Systems Evaluation Analyst - Freelance. Brings 7+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Don't disclose and Other. Education includes Bachelor of Science, University of Toronto (2019). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Systems Evaluation Analyst - Freelance

Don't discloseTextText

Evaluated AI agent behaviors and test-case structures for logical consistency, realism, and completeness. Identified missing assumptions, contradictions, and vague requirements within evaluation datasets. Defined gold-standard responses and performance benchmarks to ensure reliable AI agent evaluation. • Reviewed and validated scenario coverage • Assessed agent performance against benchmarks • Documented gaps in evaluation data • Improved evaluation quality criteria

2023 - Present

Research & Data Analyst - Remote

OtherTextText

Conducted qualitative and quantitative research to support AI data annotation, logic validation, and structured evaluation. Collaborated with data scientists to assess and improve AI model outputs using scenario-based validation. Ensured consistency, accuracy, and fairness in data labeling and evaluation while working with large datasets to analyze trends and outliers. • Supported annotation and logic validation workflows • Performed scenario-based checks on model outputs • Audited labeled data for consistency and fairness • Analyzed large datasets for patterns and anomalies

2020 - 2022

Education

U

University of Toronto

Bachelor of Science, Cognitive Science

Bachelor of Science
2016 - 2019

Work History

F

Freelance

AI Systems Evaluation Analyst

N/A
2023 - Present
F

Freelance

Research and Data Analyst

N/A
2020 - 2022