Rocky M.

Key Skills

Software

No software listed

Top Subject Matter

LLM evaluation

RAG pipelines

prompt/response verification

Top Data Types

Text

Document

Top Task Types

Prompt + Response Writing (SFT)

Freelancer Overview

Senior Software Engineer / Technical Lead — AI Platform, Full-Stack Systems & Cloud Infrastructure (AI training/evaluati. Brings 8+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include OpenAI API, LangChain, and LangGraph. Education includes Bachelor of Science, New York City College of Technology, CUNY (2018). AI-training focus includes data types such as Computer Code and Programming and labeling workflows including Evaluation, Rating, and Prompt + Response Writing (SFT).

Labeling Experience

Senior Software Engineer / Technical Lead — AI Platform, Full-Stack Systems & Cloud Infrastructure (AI training/evaluation work in production)

Built and maintained LLM verification and evaluation frameworks, including golden datasets and evaluation harnesses, to measure and improve AI-generated output quality at scale. Implemented hallucination reduction techniques and verification loops using OpenAI API and LLM tooling to ensure correct, secure, and reliable results before deployment. Established validation standards and quality gates for AI-generated code and outputs across production workflows. • Used golden datasets, eval harnesses, and accuracy/reliability metrics to calibrate model behavior • Implemented verification loops and guardrails for hallucination reduction and secure outputs • Created standardized contributor evaluation rubrics and calibration mechanisms • Supported AI-native development workflows by enforcing validation standards for AI-generated artifacts

2023 - 2025

Senior Full-Stack Engineer / Integration & Platform Lead (integration/platform work including LLM prompt/agent automation prototyping)

Prompt + Response Writing (SFT)

Prototyped LLM-based automation workflows using advanced prompt engineering and AI agent tuning to reduce manual reporting steps and improve operational efficiency. Incorporated evaluation-style guardrails through retry logic, circuit breakers, and health monitoring to maintain reliability of automated data sync workflows supporting AI training data preparation. Applied asynchronous data processing and event-driven pipelines to prepare data used for downstream AI model training. • Developed prompt-engineered agent workflows for automation • Tuned AI agents to improve reporting outputs and reduce manual work • Built data pipelines processing large daily event volumes for model training preparation • Implemented robust execution controls (retries, circuit breakers) to ensure dependable automated AI-related workloads

2022 - 2023

Full-Stack Engineer / Platform Lead

Led platform delivery work that improved engineering reliability and quality through structured code reviews and deployment quality gates. While not explicitly framed as AI training, the role supported scalable real-time event-driven systems and maintained engineering practices needed for AI/ML infrastructure readiness. • Delivered and owned backend architecture decisions across microservices • Built real-time pub/sub communication features using Socket.io/WebSocket • Established reliability improvements via code review and quality gates • Mentored engineers on platform patterns and API design standards

2020 - 2022

Full-Stack Developer / Cloud Migration Lead

Modernized legacy systems by migrating services to Python-based architectures and building serverless/microservices infrastructure using AWS and GCP. Established CI/CD pipelines and infrastructure automation with Terraform and Bicep to support repeatable deployment of data services. Although not explicitly described as AI-labeling, these platform and data-service foundations enabled later AI/ML pipeline development and deployment. • Transformed monolithic PHP systems into AWS/GCP microservices for scalability • Implemented infrastructure-as-code (Terraform/Bicep) and CI/CD automation • Managed production database environments with migrations and query optimization • Built real-time collaboration features using WebSocket technologies

2018 - 2020

Education

Work History