Shai M.

Key Skills

Software

Other

Mercor

Top Subject Matter

AI dataset validation

RLHF prompt/response quality auditing

AI training dataset quality control and progress/performance reporting

Top Data Types

Text

Computer Code Programming

Document

Top Task Types

RLHF

Classification

Freelancer Overview

AI Data Operations Specialist (Remote) — Workflow architecture and technical validation for AI training datasets (08/202. Brings 6+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Google Workspace (Docs, Slides, and Sheets). Education includes Bachelor’s Degree, Jomo Kenyatta University of Science and Technology (2020). AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

AI Data Operations Specialist (Remote) — Workflow architecture and technical validation for AI training datasets (08/2023–10/2025)

TextRLHF

Implemented structured data validation workflows for AI training inputs using Google Sheets to standardize high-volume entries. Performed technical audits of prompts and response logic to detect syntax errors and flawed execution paths affecting model behavior. • Designed conditional formatting, ARRAYFORMULA-based checks, and duplicate detection rules in Google Sheets • Converted and restructured dataset exports (JSON/CSV) via Python scripts for ingestion readiness • Authored onboarding guides and SOPs to maintain consistency for new annotators • Improved data accuracy by 30% and reduced repetitive operational work by 50% through automation

2023 - 2025

Data Operations Analyst (Remote) — QC reviews and accuracy tracking for AI training datasets (02/2021–07/2023)

Text

Conducted daily quality control reviews of AI training dataset entries on the Outlier platform, focusing on factual consistency and adherence to requirements. Built monitoring and reporting assets to track labeling progress and performance metrics for model training readiness. • Reviewed 500+ data entries daily for quality control on Outlier • Created real-time labeling dashboards in Google Sheets for accuracy and progress tracking • Produced performance reports in Google Slides to align datasets with model requirements • Developed onboarding guides to improve labeling consistency across remote teams

2021 - 2023

Data Annotation Technician (Remote) — Structured annotation and QA documentation (01/2020–01/2021)

MercorTextClassification

Performed structured annotation work for complex AI training datasets on the Mercor platform with strict adherence to labeling standards. Maintained high annotation accuracy while ensuring completeness and quality for downstream evaluation and audits. • Completed structured annotation tasks to support AI training data generation • Ensured compliance with labeling guidelines for complex dataset items • Maintained 95% accuracy for structured annotation outputs • Produced high-quality project records and documentation for quality assurance audits

2020 - 2021

Education

Work History