For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
K
Kerri B.

Kerri B.

AI Evaluation Specialist / Senior Software Engineer focused on model output evaluation and structured annotation support

USA flagEasley, Usa

Key Skills

Software

Other
Scale AIScale AI

Top Subject Matter

AI model evaluation and structured annotation workflows

Top Data Types

TextText
Computer Code ProgrammingComputer Code Programming

Top Task Types

Data CollectionData Collection
Fine-tuningFine-tuning

Freelancer Overview

AI Evaluation Specialist / Senior Software Engineer focused on model output evaluation and structured annotation support. Core strengths include Other. AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

Senior Data & AI Evaluation Specialist — Handshake AI

TextText

Processed and validated large volumes of structured and unstructured data to support AI training pipelines and model evaluation workflows. Performed precise data annotation, labeling, and quality checks on AI model outputs to maintain consistent performance. Maintained meticulous records in databases and spreadsheets for analytical review and feedback loops. • Validated dataset integrity across training pipeline inputs • Conducted annotation and labeling QA for model outputs • Ensured data integrity and consistency with high accuracy standards • Collaborated on structured documentation and feedback workflows

2025 - Present

Data Annotation & Evaluation Specialist — Outlier AI

TextText

Entered, reviewed, and validated data across AI model assessment and annotation platforms. Built and maintained scalable data pipelines to support grading and annotation workflows while improving throughput and reducing error rates. Completed software evaluation tasks requiring technical reasoning, debugging, and structured analysis. • Performed data entry, review, and validation for AI assessments • Implemented scalable pipeline support for grading and annotation • Optimized data processing to improve throughput and accuracy • Contributed to AI training and validation with strict attention to detail

2024 - Present

AI Evaluation Specialist / Senior Software Engineer focused on model output evaluation and structured annotation support

OtherTextText

Served as an AI evaluation specialist by assessing AI model outputs and supporting model validation activities. Coordinated structured annotation and evaluation workflows to ensure labeled data quality and reliable performance measurements. Produced precise written documentation for analysis, research, and validation findings across machine learning environments. • Evaluated model responses against predefined criteria • Supported structured annotation projects • Participated in technical research and model validation • Communicated results clearly to stakeholders

Present
Scale AI

Data Processing Engineer — Scale AI

Scale AIScale AITextTextData CollectionData Collection

Engineered backend data pipelines for large-scale AI data annotation systems. Optimized distributed processing workflows to improve system efficiency and support AI model training infrastructure. Collaborated with technical teams on data quality assurance and system optimization. • Built pipeline components for AI data annotation systems • Improved distributed processing efficiency • Supported AI training infrastructure and evaluation initiatives • Ensured data quality through QA-oriented collaboration

2023 - 2024

Machine Learning Data Specialist — IBM

OtherTextTextFine-tuningFine-tuning

Developed and maintained NLP datasets and machine learning training data for production environments. Built scalable backend services to ingest and process model training data for downstream training workflows. Improved pipeline reliability and performance through rigorous testing and validation of structured datasets. • Produced and maintained NLP training datasets • Implemented data ingestion and processing services for model training • Applied testing and validation to improve reliability and performance • Supported analytics workflows and cloud-based deployment for training data

2022 - 2023

Education

M

Massachusetts Institute of Technology (MIT)

Doctor of Philosophy, Software Engineering

Doctor of Philosophy
2023 - 2026
M

Massachusetts Institute of Technology (MIT)

Master of Science, Software Engineering

Master of Science
2020 - 2023

Work History

S

Scale AI

AI Data Trainer & Quality Analyst

Location not specified
Not specified