Bret B.

Key Skills

Software

Other

Labelbox

Mercor

Snorkel AI

Appen

CrowdSource

Data Annotation Tech

Top Subject Matter

AI model output validation and automated evaluation for code quality

Legal Services & Contract Review

Regulatory Compliance & Risk Analysis

Top Data Types

Computer Code Programming

Audio

Video

Top Task Types

Computer Programming/Coding

Evaluation/Rating

Fine-tuning

Prompt + Response Writing (SFT)

Transcription

Red Teaming

Freelancer Overview

I’m a Senior Software Engineer with 8+ years of experience building and scaling full-stack systems across React, Next.js, TypeScript, and backend services in .NET, Python, Java, and Node.js. My work has increasingly focused on AI-adjacent systems, including building structured data pipelines, evaluation frameworks, and role-based platforms where data quality, consistency, and user-generated content are critical. I’ve designed systems that manage large volumes of user inputs (profiles, portfolios, submissions, and reviews), with a strong emphasis on validation, schema enforcement, and downstream usability for analytics and ranking systems. In addition to core engineering work, I’ve built AI-driven certification and assessment platforms involving prompt evaluation, automated scoring logic, and moderation workflows closely aligned with data labeling and AI training pipelines. These systems required designing structured datasets, handling edge-case labeling ambiguity, and ensuring consistency across human and automated review processes. My strengths lie in bridging product logic with data integrity, building scalable annotation-like workflows, and creating systems that turn unstructured user input into reliable, model-ready datasets.

Labeling Experience

Senior Full Stack Engineer & AI Architect — Contract (Private) (01/2026 – Present)

Other

Validated Claude outputs in a Python workflow using structured feedback loops to improve correctness and reliability. Built Python evaluation pipelines to assess AI-generated code for correctness, efficiency, and security. Produced evaluation reports that identify architectural and performance risks and guide remediation work with AI engineering teams. • Performance, correctness, and security-focused evaluation of model outputs • Structured feedback loop design to improve reliability • Generation of risk and remediation reports for engineering alignment • Ongoing evaluation pipeline development in Python

2026 - Present

Aligner

Computer Code ProgrammingComputer Programming/Coding

Part time role working on multiple projects ranging from senior level programming model evaluation mostly in Python and C#. I transcribed audio files as well as creating rubrics for video content generation

2024 - 2026

Education

Work History