For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
J
Josef B.

Josef B.

Software Engineer | BrightForge Technologies | 2019–2022 (AI evaluation collaboration)

USA flagAshburn, Usa

Key Skills

Software

Anno-MageAnno-Mage
ArgillaArgilla
Google Cloud Vertex AIGoogle Cloud Vertex AI
Figure EightFigure Eight
HiveMindHiveMind
HumanaticHumanatic
LightTagLightTag
PlaymentPlayment
Snorkel AISnorkel AI
Scale AIScale AI
V7 LabsV7 Labs
VoTT
Trilldata Technologies
Other
SamaSama
ProdigyProdigy

Top Subject Matter

AI-assisted code generation evaluation
LLM/code-output evaluation (quality & failure analysis)

Top Data Types

DocumentDocument
ImageImage
VideoVideo

Top Task Types

Bounding BoxBounding Box
PolygonPolygon
SegmentationSegmentation
ClassificationClassification
Entity (NER) ClassificationEntity (NER) Classification
Point/Key PointPoint/Key Point
PolylinePolyline
Object DetectionObject Detection
CuboidCuboid
Text GenerationText Generation
Text SummarizationText Summarization
Question AnsweringQuestion Answering

Freelancer Overview

Software Engineer | BrightForge Technologies | 2019–2022 (AI evaluation collaboration). Brings 12+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal and Proprietary Tooling. Education includes Master of Science, Carnegie Mellon University (2015) and Bachelor of Science, University of Washington (2013). AI-training focus includes data types such as Computer Code and Programming and labeling workflows including Evaluation and Rating.

Labeling Experience

Senior Software Engineer | Helix Dynamics | 2022–Present (AI evaluation collaboration)

Collaborated with ML engineers to evaluate AI-generated code and document reproducible failure cases for iterative system improvement. Designed and maintained automated testing and code validation pipelines to improve reliability of AI-assisted developer workflows. Produced engineering artifacts that supported debugging throughput and higher-quality model behavior. • Assessed model-generated outputs for correctness and consistency • Captured and documented failure cases with reproducible steps • Built testing/validation pipelines using GitHub Actions • Informed refinement efforts for AI-assisted tooling

2022 - Present

Software Engineer | BrightForge Technologies | 2019–2022 (AI evaluation collaboration)

Evaluated model-generated code outputs for correctness, reliability, and logical consistency using reproducible testing methodologies and documented failure cases to support system refinement. Partnered with ML engineers to analyze outputs and ensure results met quality expectations for downstream use. Translated findings into structured technical documentation for engineering and AI research stakeholders. • Reviewed and assessed code produced by AI models • Validated reproducible failure cases and edge behaviors • Provided quality feedback to ML engineering teams • Communicated evaluation outcomes via actionable documentation

2019 - 2022

Education

C

Carnegie Mellon University

Master of Science, Computer Science

Master of Science
2013 - 2015
U

University of Washington

Bachelor of Science, Computer Science

Bachelor of Science
2009 - 2013

Work History

H

Helix Dynamics

Senior Software Engineer

Ashburn
2022 - Present
B

BrightForge Technologies

Software Engineer

Ashburn
2019 - 2021