Shaan G.

Key Skills

Software

Other

Top Subject Matter

AI data operations and audio transcription annotation quality

Generative AI evaluation and RL-style feedback for LLM behavior tuning

AI content quality assurance and rubric-based evaluation

Top Data Types

Audio

Text

Video

Document

Top Task Types

Transcription

Entity (NER) Classification

Freelancer Overview

Quality & Operations Specialist / Team Lead, Alignerr (Remote). Brings 9+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Internal, Proprietary Tooling, and Other. Education includes Bachelor of Arts, Lewis & Clark College (2022) and International Baccalaureate Diploma, UWC Mahindra College (2018). AI-training focus includes data types such as Audio and Text and labeling workflows including Transcription, Evaluation, and Rating.

Labeling Experience

Quality and Operations Specialist / Team Lead - Alignerr

AudioEntity (NER) Classification

Led quality assurance for a large-scale audio transcription annotation program and coordinated operational improvements across the team. Designed and built workflow tooling and feedback mechanisms to increase contributor effectiveness and audit consistency at volume. Owned key operational decisions related to contributor management, performance trends, and project scope adjustments. • Oversaw quality auditing across a ~1,000-person team • Built a Chrome extension to streamline aviation research workflows • Developed an NDJSON-based audit viewer with differential display to improve audit throughput • Produced evidence-based audit and trend documentation to support promotions, removals, and scope changes

2026 - 2026

Quality & Operations Specialist / Team Lead, Alignerr (Remote)

AudioTranscription

Led quality assurance for an audio transcription annotation team of ~1,000 contributors, ensuring annotated transcripts met established standards. Designed audit and feedback workflows to improve contributor performance at scale. Owned final responsibility for contributor promotion and removal decisions based on structured evaluations. • Conducted structured performance audits with trend-based feedback documents • Reviewed candidate intake submissions to assess contributor potential and underlying judgment capability • Implemented inline differential auditing to increase audit throughput and improve feedback quality • Ran onboarding and support via regular office hours for contributors

2026 - 2026

Senior Reviewer, Outlier AI (Remote)

Text

Served as a Senior Reviewer performing AI content and human annotation quality evaluations. Assessed outputs against established quality rubrics to identify issues and guide improvements. Produced detailed written justifications for quality ratings to support subsequent model refinement. • Compared AI-generated content with human annotations • Applied rubric-based checks to determine rating outcomes • Authored written rationales explaining rating decisions • Provided feedback intended for iterative model and annotation process refinement

2025 - 2025

Contract Translator, BBC World Service (Remote)

OtherText

Performed translation and localization work for multilingual BBC World Service media. Produced transcriptions, translations, and subtitles in English and Bengali. Ensured linguistic accuracy and cultural sensitivity across all translated materials. • Transcribed and translated media content • Created bilingual subtitles for localized delivery • Checked linguistic quality and correctness • Ensured cultural sensitivity in translation choices

2024 - 2024

Advanced AI Data Trainer, Invisible Technologies (Remote)

Text

Advanced AI data training by rating and annotating generative AI outputs for three major clients. Maintained quality scores above 98% while performing evaluations. Delivered detailed written feedback to support large language model behavior refinement. • Applied evaluation criteria to generative AI responses • Annotated outputs with quality judgments aligned to client standards • Wrote actionable feedback for model improvement • Ensured consistency and high accuracy across training data batches

2024 - 2024

Education

Work History