Johann C.

Key Skills

Software

AWS SageMaker

Dataloop

Google Cloud Vertex AI

Remotasks

Scale AI

Toloka

Top Subject Matter

LLM training data validation

rubric-based QA

and benchmark/rubric evaluation for model outputs

Top Data Types

3D Sensor

Computer Code Programming

Image

Text

Document

Top Task Types

Computer Programming/Coding

Evaluation/Rating

Fine-tuning

Object Detection

Prompt + Response Writing (SFT)

Classification

Freelancer Overview

Scale AI | AI Quality Assurance Engineer (AI training data labeling & evaluation). Brings 12+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI. Education includes Bachelor of Science, National University of Colombia (2019) and Diploma, Unitécnica (2016). AI-training focus includes data types such as Computer Code, Programming, and 3D Sensor and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

AI Quality Assurance Engineer - ScaleAI

Scale AIClassification

AI quality assurance engineer leading structured review and validation of AI-generated outputs for model training reliability. Focused on rubric-driven scoring, golden response verification, and failure-mode classification across multiple programming languages. Collaborated with labeling, operations, and research teams to resolve ambiguous cases and improve guideline compliance. • Built and applied detailed review rubrics and golden references • Performed consistency, regression, and adversarial prompt testing • Verified correctness, relevance, and instruction adherence • Escalated edge cases and provided research-facing quality gap documentation

2025 - Present

Independent Consultant - Independent Consulting

Scale AI3D Sensor

Independent consultant delivering software and pipeline solutions spanning AI workflow automation, web development, and 3D technical art. Provided prompt and workflow engineering, GitHub/API integrations, and containerized deployment support for client operations. Also delivered custom tools for DCC applications and provided security research services when requested. • Built AI-assisted workflow automation and prompt systems • Developed Next.js/React/TypeScript web solutions with deployment support • Created custom Python/C++/JavaScript tooling for DCC and game engines • Performed security research and remediation reporting as needed

2015 - Present

Scale AI | AI Quality Assurance Engineer (AI training data labeling & evaluation)

Scale AI

Delivered structured data annotation and quality assurance for AI-generated outputs across multiple programming domains and model training datasets. Validated training examples using golden-response verification and compared prompt outputs to detect drift. Built rubric-driven review processes and adversarial prompt cases to reveal edge-case failures and improve model reliability. • Reviewed correctness, relevance, rubric compliance, and failure-mode classification • Escalated ambiguous cases and supported researcher/ops stakeholders with documented quality gaps • Designed and validated benchmark problems with golden-reference solutions for regression checks • Provided domain expertise including supporting 3D/physics evaluation and prompt reliability checks

2025 - 2026

Newton Buffet

Scale AIComputer Code ProgrammingComputer Programming/Coding

This work involves designing high-difficulty programming prompts that challenge AI models to generate dynamic 2D and 3D physics simulations using technologies like p5.js, WebGL, or similar environments. Your responsibilities include:

2025 - 2025

Radiant Lampfish

Scale AIComputer Code ProgrammingPrompt + Response Writing (SFT)

This project focuses on collaborative front-end development using a coding model (LLM). The main goal is to iteratively build and refine interactive, visually compelling web applications with the help of AI. The workflow involves multiple cycles of coding, reviewing, and enhancing output for quality and functionality.

2025 - 2025

Show more

Education

Work History