Brian J.

Key Skills

Software

Snorkel AI

Internal/Proprietary Tooling

Top Subject Matter

No subject matter listed

Top Data Types

Audio

Document

Image

Text

Video

Top Task Types

Action Recognition

Audio Recording

Classification

Emotion Recognition

Evaluation/Rating

Fine-tuning

Prompt + Response Writing (SFT)

Question Answering

Relationship

RLHF

Segmentation

Text Generation

Text Summarization

Transcription

Translation/Localization

Freelancer Overview

I am a linguist with advanced academic training and hands-on experience in data labeling and AI training workflows across text, image, and video datasets. I evaluate large language models and vision-language systems for instruction adherence, grammatical accuracy, contextual consistency, and reasoning reliability. My work includes applying structured rubrics, identifying hallucinations and edge cases, and maintaining calibration across review cycles to ensure consistent evaluation standards. With a strong foundation in syntax, semantics, and ambiguity analysis, I bring analytical precision to multimodal annotation projects involving visual–text alignment, object categorization, and synthesized speech and video synchronization. I also use Python scripting, regex, and spreadsheet tools to support quality analysis and workflow efficiency.

Labeling Experience

Linguist – AI Training Data & Multimodal Annotation

Internal/Proprietary ToolingImageRelationshipClassification

In this role, I annotate image- and video-based datasets to evaluate visual–text alignment, object categorization accuracy, contextual consistency, and instruction adherence. I assess multimodal outputs to ensure coherence between visual content and accompanying textual responses, identifying ambiguous, misaligned, or non-compliant outputs. I apply structured evaluation criteria to support dataset quality and model reliability. Key responsibilities: Classify and evaluate multimodal content for alignment and contextual accuracy Flag inconsistencies between visual and textual components Identify ambiguous or misleading outputs Contribute feedback to refine annotation guidelines and improve consistency across review cycles

2024

AI Data Evaluator

Internal/Proprietary ToolingTextQuestion AnsweringText Generation

In this AI Data Evaluator role, I evaluate AI-generated text responses for instruction adherence, grammatical accuracy, coherence, and factual reliability. I apply structured scoring rubrics to assess reasoning quality, completeness, and alignment with task guidelines, identifying issues such as hallucinations, ambiguity, and bias. I also review synthesized speech and lip-synced video outputs for audiovisual alignment, synchronization, and timing accuracy across multimodal AI systems. Key responsibilities: Assess text outputs using structured evaluation rubrics Flag hallucinated, ambiguous, or non-compliant content Audit speech and lip-synced video outputs for synchronization and alignment Document recurring error patterns and contribute feedback to improve workflow calibration and consistency

2024

Education

Work History