Sabastian S.

Key Skills

Software

Other

Appen

AWS SageMaker

CrowdSource

CloudFactory

HiveMind

Humanatic

iMerit

Mercor

Top Subject Matter

LLM evaluation

computational correctness benchmarking

AI research

Top Data Types

Document

Text

Video

Top Task Types

Red Teaming

Bounding Box

Segmentation

Cuboid

Object Detection

Freelancer Overview

Principal AI Research Scientist and LLM Evaluation Lead – Open Mind Research Institute (Remote). Brings 7+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Other, Internal, and Proprietary Tooling. Education includes Doctor of Philosophy, Massachusetts University of Technology (MIT) (2019) and Master of Science, Stanford University (2015). AI-training focus includes data types such as Document and labeling workflows including Evaluation, Rating, and Red Teaming.

Labeling Experience

Principal AI Research Scientist and LLM Evaluation Lead – Open Mind Research Institute (Remote)

OtherDocument

Led and managed LLM evaluation work for the OpenMind Computational Correctness Benchmark. Focused on designing evaluation frameworks and coordinating asynchronous research operations across multiple time zones. Oversaw delivery of evaluation methods intended to assess model computational correctness and related behaviors. • Directed a team of 8 senior researchers on evaluation framework design. • Managed remote research workflow across 5 time zones. • Conducted prompt/response assessment activities as part of LLM evaluation. • Supported benchmark engineering and correctness-focused evaluation deliverables.

2025 - Present

Software Engineer – QOC Innovations

DocumentRed Teaming

Built automated testing pipelines to improve reliability and vulnerability detection for an AI-adjacent platform. Led internal red-teaming initiatives to strengthen platform security posture. Produced documentation supporting mitigation and system hardening for risk reduction. • Developed/maintained automated testing pipelines to surface issues. • Conducted or coordinated red-teaming activities to identify security weaknesses. • Authored technical documentation for mitigations and hardening steps. • Supported continuous reliability and vulnerability detection efforts.

2024 - 2024

Education

Work History